-- Logs begin at Sat 2022-02-12 03:26:58 UTC, end at Sat 2022-02-12 04:39:09 UTC. -- Feb 12 03:58:20.364915 dv-cinder-828696-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 12 03:58:20.373545 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 12 03:58:20 2022] *** Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: nodename: dv-cinder-828696-3-iscsi Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: machine: x86_64 Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: clock source: unix Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: pcre jit disabled Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: detected number of CPU cores: 4 Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: current working directory: / Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: detected binary path: /usr/bin/uwsgi-core Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: your processes number limit is 47680 Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: your memory page size is 4096 bytes Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: detected max file descriptor number: 2048 Feb 12 03:58:20.375537 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: lock engine: pthread robust mutexes Feb 12 03:58:20.376280 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: thunder lock: enabled Feb 12 03:58:20.376280 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 12 03:58:20.376280 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 12 03:58:20.421190 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: Python main interpreter initialized at 0x55a5be2eb9c0 Feb 12 03:58:20.421190 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: python threads support enabled Feb 12 03:58:20.421190 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: your server socket listen backlog is limited to 100 connections Feb 12 03:58:20.421190 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: your mercy for graceful operations on workers is 90 seconds Feb 12 03:58:20.421553 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: mapped 403077 bytes (393 KB) for 2 cores Feb 12 03:58:20.421623 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: *** Operational MODE: preforking *** Feb 12 03:58:20.421894 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: *** uWSGI is running in multiple interpreter mode *** Feb 12 03:58:20.421894 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: spawned uWSGI master process (pid: 79502) Feb 12 03:58:20.422073 dv-cinder-828696-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 12 03:58:20.423127 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: spawned uWSGI worker 1 (pid: 79509, cores: 1) Feb 12 03:58:20.423127 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: spawned uWSGI worker 2 (pid: 79510, cores: 1) Feb 12 03:58:20.423127 dv-cinder-828696-3-iscsi devstack@keystone.service[79502]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 12 03:58:26.124207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 03:58:26.124207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: from cryptography.utils import int_from_bytes Feb 12 03:58:26.125036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 03:58:26.125036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: from cryptography.utils import int_from_bytes Feb 12 03:58:26.125516 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 03:58:26.125516 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: from cryptography.utils import int_from_bytes Feb 12 03:58:26.125623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 03:58:26.125623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: from cryptography.utils import int_from_bytes Feb 12 03:58:26.169158 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 03:58:26.169328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 03:58:26.169417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 03:58:26.169506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 03:58:26.169583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] command line args: [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 03:58:26.169664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] command line args: [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 03:58:26.169818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 03:58:26.169903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 03:58:26.169980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ================================================================================ {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 03:58:26.170056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ================================================================================ {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 03:58:26.170240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] admin_token = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.170329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] admin_token = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.170480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] config_dir = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.170563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] config_dir = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.170670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.170753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.170830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] config_source = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.170911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] config_source = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] debug = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] debug = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171838 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.171938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.172038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.172142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.172760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.172864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.172969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] list_limit = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] list_limit = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] log_config_append = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] log_config_append = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] log_dir = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] log_dir = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] log_file = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.173957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] log_file = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174061 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.174894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.175977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176295 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.176890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.177025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.177395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.177540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.177631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] publish_errors = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.177709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] publish_errors = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.177819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.177944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.178903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] standard_threads = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] standard_threads = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179413 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] use_journal = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] use_json = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] use_journal = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.179992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] use_stderr = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.180069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] use_json = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.180146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] use_syslog = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.180218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] use_stderr = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.180339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.180420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] use_syslog = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.180548 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.180631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 03:58:26.180786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.180869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.181866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182501 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.182995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.183945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.184921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.185926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.186966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.187113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.187190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.187343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.187425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.187581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.187658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.187951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.188555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.188635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.188711 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.188860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.188937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.189955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.190997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191076 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191224 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191809 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.191998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.192911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193061 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.193884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.194955 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.195879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.196885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.197863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.198961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199661 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.199970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.200915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.201890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202598 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.202975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.203988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.204916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205593 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] auth.external = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.205901 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] auth.external = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] auth.password = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.206878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] auth.token = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] auth.password = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] auth.token = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.207949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] credential.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.208952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.209116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] credential.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.209202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.209380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.209473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.209627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.209951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.210897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.211910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.212910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.213890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.214855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.215996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.216956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.217992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218713 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.218943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.219959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.220929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.221886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222349 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.222976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223450 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.223931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.224924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.225877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.226956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.227983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.228918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229338 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.229892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.230963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231691 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.231922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232163 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.232988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.233975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.234056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.234223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.234302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.234474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.234552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.235218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.235306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.235461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.235546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.235695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.235799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.235965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.236980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237477 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.237983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.238126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.238266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.238375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.238518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.238597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.238767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.238853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.239961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] role.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] role.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] role.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] role.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.240926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.241932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.242965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.243131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.243210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.243375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.243454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.243621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.243698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.243873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.244985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.245976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.246981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.247947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.248895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.249842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.250852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251713 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.251955 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.252953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.connection = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253291 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.connection = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.253934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254477 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.254938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.255871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.256967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.257043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.257197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.257317 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.257452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 03:58:26.257532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 03:58:26.257604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 03:58:26.288758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.288944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.289037 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.289177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.289262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.289511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.298217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.298548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.327926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.328154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.332763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.332995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.380651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.380992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.431391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.431615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.431704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.431857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.496686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.496870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.496961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.497979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.522747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.522976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523064 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.523939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.524064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.524156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.524273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.535654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.535849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.548252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.548481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.548568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.548706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.548790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.548930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.549831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 03:58:26.567263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.567366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.567473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 03:58:26.567570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 03:58:26.567810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.567894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.568006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 03:58:26.568087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 03:58:26.568271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.568362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.568529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.568608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.568777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.568858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.569027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.569109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.579485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.579581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.579920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.580002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.580190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.580272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.580466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.580548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.588567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.588671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.591739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.591824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.592015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.592096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.592290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.592373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.592566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.592647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.592843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.592930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.593996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.594802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.594884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.595071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.595197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.620463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.620804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.622060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.622340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.622422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.622653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.628052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.628327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.628409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.628599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.628682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.628872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.635688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.635880 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.636039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.636159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.640237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.640442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.640524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.640724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.640805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.641048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.641134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.641351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.641433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.641621 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.641760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.641997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.642108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.642266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.642355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.642529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.660727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.660982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.661065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.661254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.665570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.665887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.669233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.669390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.669556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.669678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.674511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.674601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.678022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.678130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.681572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.681668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.681862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.681943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.682140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.682224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.682539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.682620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.682822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.682916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.683093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.683176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.701946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.702038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.702232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.702315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.702492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.702575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.702750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.702840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.710808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.710902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.712458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.712541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.712728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.712823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.715669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.715754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.715945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.716027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.716220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.716303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.716495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.716576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.716776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.716864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.730291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.730382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.730564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.730646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.730837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.730930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.731112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.731194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.731387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.731468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.731652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.731734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.731929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.732010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.749156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.749256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.752944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.753035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.756136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.756252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.757706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.757823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.759261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.759392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.759535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.759668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.759819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.759948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.768039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.768313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.769712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.769941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.772794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.773058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.773151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.773368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.773453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.773639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.773721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.773908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.782918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.783193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.783276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.783464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.783547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.783757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.889424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.889641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.890076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.890206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.890459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.890730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.891563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.891842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.892114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.892392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.892669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.892927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.893195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.893486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.894151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 03:58:26.894446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.894722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.894993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.895273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.895540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.895816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.896077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.896340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.896618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.896892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.897157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.897447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.897715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 03:58:26.930938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5be2eb9c0 pid: 79510 (default app) Feb 12 03:58:26.934215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67efdd-7cd6-40d5-a9f4-b100872b8be9 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:26.934509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67efdd-7cd6-40d5-a9f4-b100872b8be9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:26.934787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67efdd-7cd6-40d5-a9f4-b100872b8be9 None None] PATH_INFO: `/v3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:26.935519 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5be2eb9c0 pid: 79509 (default app) Feb 12 03:58:26.939032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 791 bytes} [Sat Feb 12 03:58:26 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:35.941262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c01dc-288e-4154-bb47-d81467d32ffd None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:35.941815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c01dc-288e-4154-bb47-d81467d32ffd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:35.942560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c01dc-288e-4154-bb47-d81467d32ffd None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:35.947627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1/2] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:58:35.952847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af632dca-da58-4945-9b19-b4637525d488 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:35.953256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af632dca-da58-4945-9b19-b4637525d488 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:35.953419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af632dca-da58-4945-9b19-b4637525d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:35.983022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG oslo_db.sqlalchemy.engines [None req-af632dca-da58-4945-9b19-b4637525d488 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 03:58:36.164644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG passlib.handlers.bcrypt [None req-af632dca-da58-4945-9b19-b4637525d488 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79510) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 12 03:58:36.165060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG passlib.handlers.bcrypt [None req-af632dca-da58-4945-9b19-b4637525d488 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79510) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 12 03:58:36.220500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-af632dca-da58-4945-9b19-b4637525d488 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:36.222060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-af632dca-da58-4945-9b19-b4637525d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:36.351307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 2/3] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:36.441017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c01dc-288e-4154-bb47-d81467d32ffd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:36.474371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG oslo_db.sqlalchemy.engines [None req-ef3c01dc-288e-4154-bb47-d81467d32ffd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 03:58:36.600220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c01dc-288e-4154-bb47-d81467d32ffd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:36.604524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36496e-bf6d-479b-8663-0cde38ea473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:36.605176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36496e-bf6d-479b-8663-0cde38ea473c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:36.605703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36496e-bf6d-479b-8663-0cde38ea473c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:36.605981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36496e-bf6d-479b-8663-0cde38ea473c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:36.615182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36496e-bf6d-479b-8663-0cde38ea473c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:36.666547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bc36496e-bf6d-479b-8663-0cde38ea473c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 12 03:58:36.666885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36496e-bf6d-479b-8663-0cde38ea473c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:36.676521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 2/4] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:58:36.682422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af632dca-da58-4945-9b19-b4637525d488 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:36.696985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af632dca-da58-4945-9b19-b4637525d488 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:36.701412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a33e33-745c-4527-a0c3-69763c6977aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:36.702510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33e33-745c-4527-a0c3-69763c6977aa admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:36.702796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33e33-745c-4527-a0c3-69763c6977aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:36.703076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a33e33-745c-4527-a0c3-69763c6977aa admin admin] PATH_INFO: `/v3/projects/ea391da9e944423da861a63f18f0eef9` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:36.704662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a33e33-745c-4527-a0c3-69763c6977aa admin admin] RBAC: Authorizing `identity:get_project(project_id=ea391da9e944423da861a63f18f0eef9)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:36.756181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46a33e33-745c-4527-a0c3-69763c6977aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 12 03:58:36.756468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a33e33-745c-4527-a0c3-69763c6977aa admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:36.761040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 3/5] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:36 2022] GET /identity/v3/projects/ea391da9e944423da861a63f18f0eef9 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:38.915806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e727-e938-47c0-afad-2edd1fe58bb6 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:38.916344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e727-e938-47c0-afad-2edd1fe58bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:38.916344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e727-e938-47c0-afad-2edd1fe58bb6 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:38.920877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 3/6] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:38.927044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0612fb-78c3-4227-80e5-22128edbccf3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:38.927451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0612fb-78c3-4227-80e5-22128edbccf3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:38.927611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0612fb-78c3-4227-80e5-22128edbccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:38.946740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6a0612fb-78c3-4227-80e5-22128edbccf3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:38.948262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6a0612fb-78c3-4227-80e5-22128edbccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:38.956094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:38.977719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e727-e938-47c0-afad-2edd1fe58bb6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:38.989902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e727-e938-47c0-afad-2edd1fe58bb6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:38.994103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2c24d-041f-4e9f-84f2-2dcf59aad0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:38.994715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c24d-041f-4e9f-84f2-2dcf59aad0dd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:38.994995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c24d-041f-4e9f-84f2-2dcf59aad0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:38.995269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2c24d-041f-4e9f-84f2-2dcf59aad0dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:39.003208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2c24d-041f-4e9f-84f2-2dcf59aad0dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:39.004983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2c24d-041f-4e9f-84f2-2dcf59aad0dd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:39.013339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 4/8] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:58:39.018291 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0612fb-78c3-4227-80e5-22128edbccf3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:39.027057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0612fb-78c3-4227-80e5-22128edbccf3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:39.031443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079a8b5-e15d-4ad6-9eab-9e9100dca5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:39.032280 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a8b5-e15d-4ad6-9eab-9e9100dca5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:39.032562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a8b5-e15d-4ad6-9eab-9e9100dca5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:39.032837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a8b5-e15d-4ad6-9eab-9e9100dca5b3 admin admin] PATH_INFO: `/v3/users/11bc38186327459cb57d952300827ad5` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:39.034277 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079a8b5-e15d-4ad6-9eab-9e9100dca5b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=11bc38186327459cb57d952300827ad5)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:39.036095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079a8b5-e15d-4ad6-9eab-9e9100dca5b3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:39.037657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 5/9] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:39 2022] GET /identity/v3/users/11bc38186327459cb57d952300827ad5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:41.267634 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cc09c-9ef5-427f-9edb-7d91b6797d56 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.268174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cc09c-9ef5-427f-9edb-7d91b6797d56 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.268174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cc09c-9ef5-427f-9edb-7d91b6797d56 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.269913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 5/10] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:41.275226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7f7eb-c64a-42af-b8a5-2dd144028374 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.275977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7f7eb-c64a-42af-b8a5-2dd144028374 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.276253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7f7eb-c64a-42af-b8a5-2dd144028374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.294263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5ce7f7eb-c64a-42af-b8a5-2dd144028374 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:41.295429 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5ce7f7eb-c64a-42af-b8a5-2dd144028374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:41.302946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 6/11] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:41.318323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532fd75-d3c8-4733-a476-69615ac19bc5 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.318685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532fd75-d3c8-4733-a476-69615ac19bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.319048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532fd75-d3c8-4733-a476-69615ac19bc5 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.320833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 6/12] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:41.325200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7f7eb-c64a-42af-b8a5-2dd144028374 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:41.325740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.326052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.326332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.334686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7f7eb-c64a-42af-b8a5-2dd144028374 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:41.339300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:41.340076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.340363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.340639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.353890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:41.360683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:58:41.361891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 7/13] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:41.367427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:41.368606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG passlib.handlers.bcrypt [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79509) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 12 03:58:41.369033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG passlib.handlers.bcrypt [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79509) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 12 03:58:41.376723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abd0f-fc20-42eb-92aa-0a240d0825f4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:41.381048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:41.381692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.381981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.382262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.383015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:41.383325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:41.385066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:41.385066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:58:41.385066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:58:41.386000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:41.399214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 8/14] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:41.404253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:41.413718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e3370-e8c4-4d04-a882-5bcf42c183b3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:41.416590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:41.418208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:41.418343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:41.419020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.419304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.419582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] PATH_INFO: `/v3/users/11bc38186327459cb57d952300827ad5` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.420790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] RBAC: Authorizing `identity:get_user(user_id=11bc38186327459cb57d952300827ad5)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:41.422595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:41.424087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 9/15] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:41 2022] GET /identity/v3/users/11bc38186327459cb57d952300827ad5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:41.428995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:41.438034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fd76f-c81e-4d05-bafb-f45811531e49 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:41.440500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 7/16] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:58:41.442992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:41.443709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.443997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.444278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.445484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:41.447142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:41.448638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 10/17] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:41.453852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:41.463296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:41.463976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6c03e-34b0-49df-8662-667ce49640f6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:41.468325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:41.469312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.469665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.469946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.471014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.domain.id=default, user.id=11bc38186327459cb57d952300827ad5) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:41.471335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:41.472814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1363a-9a89-4f21-b6a8-0e01a026b088 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:41.473120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:41.473120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:58:41.473120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:58:41.474329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:41.477128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5dbb3-f440-42eb-9341-eaba930dd04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:41.477773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5dbb3-f440-42eb-9341-eaba930dd04c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.478055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5dbb3-f440-42eb-9341-eaba930dd04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.478327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5dbb3-f440-42eb-9341-eaba930dd04c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.483411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 8/18] 10.222.0.31 () {56 vars in 1343 bytes} [Sat Feb 12 03:58:41 2022] GET /identity/v3/role_assignments?user.id=11bc38186327459cb57d952300827ad5&scope.domain.id=default&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:41.486422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5dbb3-f440-42eb-9341-eaba930dd04c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:41.488199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5dbb3-f440-42eb-9341-eaba930dd04c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:41.498045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 11/19] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:58:41.504536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:41.514715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa6da-b52c-4a7d-be61-69a615e19cc0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:41.519925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d0511-bbcd-42fd-ba53-da996714c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:41.520657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0511-bbcd-42fd-ba53-da996714c686 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:41.520935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0511-bbcd-42fd-ba53-da996714c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:41.521207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d0511-bbcd-42fd-ba53-da996714c686 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:41.522703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0511-bbcd-42fd-ba53-da996714c686 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:41.524464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d0511-bbcd-42fd-ba53-da996714c686 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:41.526111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 9/20] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:44.314062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dfd27-84b5-4c5c-bc4a-9a6f050a487f None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.314578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dfd27-84b5-4c5c-bc4a-9a6f050a487f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.314650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dfd27-84b5-4c5c-bc4a-9a6f050a487f None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.316905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 12/21] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:44.321811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeedad-adea-4695-8c17-ae8f59779e3a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.322709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeedad-adea-4695-8c17-ae8f59779e3a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.323217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eeedad-adea-4695-8c17-ae8f59779e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.353299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-17eeedad-adea-4695-8c17-ae8f59779e3a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:44.353299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-17eeedad-adea-4695-8c17-ae8f59779e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:44.366391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 10/22] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:44.402715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dfd27-84b5-4c5c-bc4a-9a6f050a487f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.421925 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dfd27-84b5-4c5c-bc4a-9a6f050a487f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.426475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.427323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.427612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.427891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.447475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:44.449455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:44.465689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34227-a3c2-46a2-bfc4-7973990bbf70 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.465977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34227-a3c2-46a2-bfc4-7973990bbf70 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.466258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c34227-a3c2-46a2-bfc4-7973990bbf70 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.468256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 11/23] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:44.471950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:58:44.473656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbbc85-4ef3-4acc-acd5-3ffe1a496f9d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.473768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 13/24] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:44.473962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbbc85-4ef3-4acc-acd5-3ffe1a496f9d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.474208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbbc85-4ef3-4acc-acd5-3ffe1a496f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.481689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.494186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351214-6b4a-4b42-b096-a8b800ea1cff admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.504252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.504904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.505191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.505508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.506354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:44.506672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:44.507678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:44.507678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:58:44.507678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:58:44.508585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:44.510467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-5dfbbc85-4ef3-4acc-acd5-3ffe1a496f9d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:44.511686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5dfbbc85-4ef3-4acc-acd5-3ffe1a496f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:44.528884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 12/25] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:58:44.537155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 14/26] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:44.542221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbbc85-4ef3-4acc-acd5-3ffe1a496f9d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.554453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbbc85-4ef3-4acc-acd5-3ffe1a496f9d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.564900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.565601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.565965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.566465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.567182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.567287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:44.568211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:44.568211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:58:44.568211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:58:44.569466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:44.587759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6271d-532e-4ce6-a8b8-825093487b28 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.601955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.602765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.603047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.603327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.624470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:44.632202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:58:44.633838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 15/27] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:58:44.639383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.655918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4cc58-46f3-4da9-bcb2-ace7a5be8d84 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.661538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a17c2-5d51-432a-bf9c-666bac461eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.662494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a17c2-5d51-432a-bf9c-666bac461eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.662919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a17c2-5d51-432a-bf9c-666bac461eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.665935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a17c2-5d51-432a-bf9c-666bac461eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.665935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a17c2-5d51-432a-bf9c-666bac461eaa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:44.665935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a17c2-5d51-432a-bf9c-666bac461eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:44.666192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a17c2-5d51-432a-bf9c-666bac461eaa admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:44.676223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 16/28] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:44.677843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6334a2-6125-4c18-9aa4-04275180a663 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.678180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6334a2-6125-4c18-9aa4-04275180a663 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.678466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6334a2-6125-4c18-9aa4-04275180a663 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.680666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 17/29] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:44.685834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6334a2-6125-4c18-9aa4-04275180a663 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.699344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6334a2-6125-4c18-9aa4-04275180a663 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.703959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f98b0-22cb-4610-b765-7478aa9fc1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.704834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f98b0-22cb-4610-b765-7478aa9fc1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.705119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f98b0-22cb-4610-b765-7478aa9fc1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.705422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f98b0-22cb-4610-b765-7478aa9fc1d5 admin admin] PATH_INFO: `/v3/users/11bc38186327459cb57d952300827ad5` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.706659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f98b0-22cb-4610-b765-7478aa9fc1d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=11bc38186327459cb57d952300827ad5)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:44.708538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f98b0-22cb-4610-b765-7478aa9fc1d5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:44.710791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 18/30] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:44 2022] GET /identity/v3/users/11bc38186327459cb57d952300827ad5 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:44.711989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9929-ec71-4251-9632-bbc1521b4752 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.712272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9929-ec71-4251-9632-bbc1521b4752 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.712546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9929-ec71-4251-9632-bbc1521b4752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.731671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-8dfe9929-ec71-4251-9632-bbc1521b4752 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:44.732942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8dfe9929-ec71-4251-9632-bbc1521b4752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:44.741722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 19/31] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:44.742529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe9929-ec71-4251-9632-bbc1521b4752 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.759141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe9929-ec71-4251-9632-bbc1521b4752 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.768235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.769226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.769702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.770105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.771486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:44.773469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:44.775564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 20/32] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:44.781001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.798245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777d71-a0e4-45c1-89c7-9ea45f261c5f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:44.803114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1edee3-6d80-44fe-9160-4dacf20ca120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:44.804195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edee3-6d80-44fe-9160-4dacf20ca120 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:44.804616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edee3-6d80-44fe-9160-4dacf20ca120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:44.805033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1edee3-6d80-44fe-9160-4dacf20ca120 admin admin] PATH_INFO: `/v3/domains/default/users/11bc38186327459cb57d952300827ad5/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:44.807329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1edee3-6d80-44fe-9160-4dacf20ca120 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=11bc38186327459cb57d952300827ad5, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:44.808487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-6e1edee3-6d80-44fe-9160-4dacf20ca120 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:44.808487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:58:44.808487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:58:44.810878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1edee3-6d80-44fe-9160-4dacf20ca120 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:44.861051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 13/33] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 03:58:44 2022] POST /identity/v3/projects => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 03:58:44.862199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:44.969317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242278ef-5f3a-48eb-80c2-2df102a5e2d5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:45.085525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f8db3-7d82-40a6-818e-11fb38473004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:45.086129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8db3-7d82-40a6-818e-11fb38473004 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.086424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8db3-7d82-40a6-818e-11fb38473004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.089298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f8db3-7d82-40a6-818e-11fb38473004 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.089298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f8db3-7d82-40a6-818e-11fb38473004 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:45.089298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-4c6f8db3-7d82-40a6-818e-11fb38473004 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:45.089298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:58:45.089298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:58:45.089810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f8db3-7d82-40a6-818e-11fb38473004 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:45.109039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 21/34] 10.222.0.31 () {58 vars in 1382 bytes} [Sat Feb 12 03:58:44 2022] PUT /identity/v3/domains/default/users/11bc38186327459cb57d952300827ad5/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 03:58:45.111650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b810e0-d942-4639-96e7-1775af078884 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.111947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b810e0-d942-4639-96e7-1775af078884 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.112227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b810e0-d942-4639-96e7-1775af078884 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.117839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 22/35] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:45.124273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d5b79-b750-49e4-8edc-0edaddad8a67 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.124789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d5b79-b750-49e4-8edc-0edaddad8a67 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.125199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d5b79-b750-49e4-8edc-0edaddad8a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.147296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c59d5b79-b750-49e4-8edc-0edaddad8a67 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:45.149467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c59d5b79-b750-49e4-8edc-0edaddad8a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:45.159561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 23/36] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:45.183252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d5b79-b750-49e4-8edc-0edaddad8a67 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:45.193164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d5b79-b750-49e4-8edc-0edaddad8a67 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:45.198030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db068a-577c-4b09-a903-f60183445adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:45.198827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db068a-577c-4b09-a903-f60183445adf admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.199115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db068a-577c-4b09-a903-f60183445adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.199397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db068a-577c-4b09-a903-f60183445adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.200198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db068a-577c-4b09-a903-f60183445adf admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:45.201511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-67db068a-577c-4b09-a903-f60183445adf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:45.201511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:58:45.201511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:58:45.202449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db068a-577c-4b09-a903-f60183445adf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:45.269520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 14/37] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 03:58:44 2022] POST /identity/v3/roles => generated 219 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:58:45.337624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 24/38] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 03:58:45 2022] POST /identity/v3/roles => generated 225 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:58:45.418412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56141-0bd7-4124-98c7-260c4721a0d4 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.419877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56141-0bd7-4124-98c7-260c4721a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.420684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca56141-0bd7-4124-98c7-260c4721a0d4 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.424567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 15/39] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:45.430376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22341a-473a-4d0f-b552-26eea2851a00 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.430730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22341a-473a-4d0f-b552-26eea2851a00 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.430961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22341a-473a-4d0f-b552-26eea2851a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.453683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-cd22341a-473a-4d0f-b552-26eea2851a00 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:45.455585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-cd22341a-473a-4d0f-b552-26eea2851a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:45.469435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 25/40] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:45.488950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca56141-0bd7-4124-98c7-260c4721a0d4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:45.503171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca56141-0bd7-4124-98c7-260c4721a0d4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:45.507727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:45.508420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.508708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.508992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.509828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:45.511506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:45.562357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733a1b3-34f8-472f-95f8-07d1a388e99d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.562653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733a1b3-34f8-472f-95f8-07d1a388e99d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.562928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733a1b3-34f8-472f-95f8-07d1a388e99d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.565545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 26/41] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:58:45.570756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac6e3-9915-4dcf-aab7-b5951da62137 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.571200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac6e3-9915-4dcf-aab7-b5951da62137 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.571579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac6e3-9915-4dcf-aab7-b5951da62137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.590850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2c9ac6e3-9915-4dcf-aab7-b5951da62137 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:45.591993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2c9ac6e3-9915-4dcf-aab7-b5951da62137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:45.599805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 27/42] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:45.608182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 16/43] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 03:58:45 2022] POST /identity/v3/roles => generated 223 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:58:45.630631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ac6e3-9915-4dcf-aab7-b5951da62137 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:45.641209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ac6e3-9915-4dcf-aab7-b5951da62137 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:45.646074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76345e03-99d3-41a9-8852-a57edc5e14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:45.646951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76345e03-99d3-41a9-8852-a57edc5e14a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.647244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76345e03-99d3-41a9-8852-a57edc5e14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.647526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76345e03-99d3-41a9-8852-a57edc5e14a8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.648830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76345e03-99d3-41a9-8852-a57edc5e14a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:45.650701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76345e03-99d3-41a9-8852-a57edc5e14a8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:45.652368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 28/44] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:45.660158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:45.673210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7f111-c6d8-41c1-9bfb-fdbaabe82702 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:45.678615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89bca7-3f27-4afc-a1ee-ca9a31aa3090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:45.679497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89bca7-3f27-4afc-a1ee-ca9a31aa3090 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:45.679862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89bca7-3f27-4afc-a1ee-ca9a31aa3090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:45.680216 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89bca7-3f27-4afc-a1ee-ca9a31aa3090 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:45.681031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89bca7-3f27-4afc-a1ee-ca9a31aa3090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:45.683187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89bca7-3f27-4afc-a1ee-ca9a31aa3090 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:45.774257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 17/45] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 03:58:45 2022] POST /identity/v3/projects => generated 312 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:58:47.559443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f99b-9f25-40d0-8d32-70ec4f88fa73 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:47.559931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f99b-9f25-40d0-8d32-70ec4f88fa73 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:47.560012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f99b-9f25-40d0-8d32-70ec4f88fa73 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:47.561768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 29/46] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:47.567136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c2ae5-1503-4a60-8d08-bd2eae22edfd None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:47.567572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c2ae5-1503-4a60-8d08-bd2eae22edfd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:47.567702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c2ae5-1503-4a60-8d08-bd2eae22edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:47.585627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2c0c2ae5-1503-4a60-8d08-bd2eae22edfd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:47.587145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2c0c2ae5-1503-4a60-8d08-bd2eae22edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:47.642926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 18/47] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:47.666052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f99b-9f25-40d0-8d32-70ec4f88fa73 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:47.678122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f99b-9f25-40d0-8d32-70ec4f88fa73 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:47.684201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:47.685592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:47.686099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:47.686610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:47.700184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:47.707477 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:58:47.708635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 30/48] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:47.714669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c2ae5-1503-4a60-8d08-bd2eae22edfd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:47.723481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c2ae5-1503-4a60-8d08-bd2eae22edfd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:47.727953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:47.728609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:47.728896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:47.729199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:47.729994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:47.730304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:47.731324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:47.731324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:58:47.731324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:58:47.732235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:47.746905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 19/49] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:47.753383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:47.764008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5838ff9-221f-4dac-bde1-774339789e0d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:47.769131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:47.770097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:47.770378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:47.770653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] PATH_INFO: `/v3/users/11bc38186327459cb57d952300827ad5` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:47.771873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] RBAC: Authorizing `identity:get_user(user_id=11bc38186327459cb57d952300827ad5)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:47.773733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:47.775315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 31/50] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:47 2022] GET /identity/v3/users/11bc38186327459cb57d952300827ad5 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:47.780802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:47.790586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca72e8-543f-45db-a1fb-a5b7765a3fbc admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:47.795014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d9fc4-2e5c-4834-85ea-90d26eaf96bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:47.795786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9fc4-2e5c-4834-85ea-90d26eaf96bf admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:47.796073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9fc4-2e5c-4834-85ea-90d26eaf96bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:47.796352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9fc4-2e5c-4834-85ea-90d26eaf96bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:47.798071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d9fc4-2e5c-4834-85ea-90d26eaf96bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:47.799788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d9fc4-2e5c-4834-85ea-90d26eaf96bf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:47.801630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 20/51] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:47.806933 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:47.816932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80df5-0b11-4e50-92d4-64286d47545d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:47.821228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:47.821961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:47.822312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:47.822657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:47.823560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.domain.id=default, user.id=11bc38186327459cb57d952300827ad5) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:47.823878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:47.824858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:47.824858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:58:47.824858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:58:47.826018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaf564-bd87-4661-9217-94f3fac47ebb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:47.832852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 32/52] 10.222.0.31 () {56 vars in 1343 bytes} [Sat Feb 12 03:58:47 2022] GET /identity/v3/role_assignments?user.id=11bc38186327459cb57d952300827ad5&scope.domain.id=default&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:48.020915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572ffc-c620-43d2-9c78-91676eb80e34 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:48.021208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572ffc-c620-43d2-9c78-91676eb80e34 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:48.021529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572ffc-c620-43d2-9c78-91676eb80e34 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:48.023436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 21/53] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:48.028779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554c6e-76a0-483e-8b52-837b740b5408 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:48.029071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554c6e-76a0-483e-8b52-837b740b5408 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:48.029468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554c6e-76a0-483e-8b52-837b740b5408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:48.047943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3e554c6e-76a0-483e-8b52-837b740b5408 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:48.049127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3e554c6e-76a0-483e-8b52-837b740b5408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:48.056818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 33/54] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:48.079940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4572ffc-c620-43d2-9c78-91676eb80e34 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:48.092179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4572ffc-c620-43d2-9c78-91676eb80e34 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:48.097103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a146b7-acb1-44a3-bc0c-a166270e998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:48.097903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a146b7-acb1-44a3-bc0c-a166270e998e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:48.098196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a146b7-acb1-44a3-bc0c-a166270e998e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:48.098476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a146b7-acb1-44a3-bc0c-a166270e998e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:48.099666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a146b7-acb1-44a3-bc0c-a166270e998e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:48.101403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a146b7-acb1-44a3-bc0c-a166270e998e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:48.102953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 22/55] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:48.108242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554c6e-76a0-483e-8b52-837b740b5408 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:48.116990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554c6e-76a0-483e-8b52-837b740b5408 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:48.121265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2df1c5-072b-434e-a3c1-723fde23cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:48.121924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2df1c5-072b-434e-a3c1-723fde23cb73 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:48.122206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2df1c5-072b-434e-a3c1-723fde23cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:48.122484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2df1c5-072b-434e-a3c1-723fde23cb73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:48.123191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2df1c5-072b-434e-a3c1-723fde23cb73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:48.124191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-9a2df1c5-072b-434e-a3c1-723fde23cb73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:48.124191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:58:48.124191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:58:48.125412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2df1c5-072b-434e-a3c1-723fde23cb73 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:48.207004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 34/56] 10.222.0.31 () {60 vars in 1161 bytes} [Sat Feb 12 03:58:48 2022] POST /identity/v3/projects => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:58:50.375192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2322f-341c-49a6-8e52-110d4480b064 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:50.375688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2322f-341c-49a6-8e52-110d4480b064 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:50.375913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2322f-341c-49a6-8e52-110d4480b064 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:50.378209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 23/57] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:50.383405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f343-271f-4678-8181-6df89d45818f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:50.383803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f343-271f-4678-8181-6df89d45818f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:50.383960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f343-271f-4678-8181-6df89d45818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:50.401139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3c61f343-271f-4678-8181-6df89d45818f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:50.402352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3c61f343-271f-4678-8181-6df89d45818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:50.456527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 35/58] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:50.481510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2322f-341c-49a6-8e52-110d4480b064 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:50.494041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2322f-341c-49a6-8e52-110d4480b064 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:50.498264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875be905-d448-4a31-8441-db4d061e8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:50.499027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875be905-d448-4a31-8441-db4d061e8afe admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:50.499314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875be905-d448-4a31-8441-db4d061e8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:50.499592 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875be905-d448-4a31-8441-db4d061e8afe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:50.500768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875be905-d448-4a31-8441-db4d061e8afe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:50.502498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875be905-d448-4a31-8441-db4d061e8afe admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:50.504036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 24/59] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:50.508990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61f343-271f-4678-8181-6df89d45818f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:50.517677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61f343-271f-4678-8181-6df89d45818f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:50.521915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69ba98-a62a-4853-8c80-439bb071ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:50.522554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ba98-a62a-4853-8c80-439bb071ad55 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:50.522836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ba98-a62a-4853-8c80-439bb071ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:50.523113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69ba98-a62a-4853-8c80-439bb071ad55 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:50.523816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ba98-a62a-4853-8c80-439bb071ad55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:50.524819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-9b69ba98-a62a-4853-8c80-439bb071ad55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:50.524819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:58:50.524819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:58:50.526055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69ba98-a62a-4853-8c80-439bb071ad55 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:50.623001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 36/60] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:58:50 2022] POST /identity/v3/users => generated 275 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:58:53.872882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be6027-83b9-4eed-9531-89f7d0e63dbd None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:53.873947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be6027-83b9-4eed-9531-89f7d0e63dbd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:53.874432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be6027-83b9-4eed-9531-89f7d0e63dbd None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:53.876733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 25/61] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:53.882284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2013-f770-44d1-84ca-8da7a00a02a1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:53.883104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2013-f770-44d1-84ca-8da7a00a02a1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:53.883577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f2013-f770-44d1-84ca-8da7a00a02a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:53.907425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-654f2013-f770-44d1-84ca-8da7a00a02a1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:53.908950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-654f2013-f770-44d1-84ca-8da7a00a02a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:53.919398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 37/62] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:58:53.942646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be6027-83b9-4eed-9531-89f7d0e63dbd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:53.961828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be6027-83b9-4eed-9531-89f7d0e63dbd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:53.969254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:53.970369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:53.970865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:53.971331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:53.998541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:54.006192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:58:54.008134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 26/63] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:54.014198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f2013-f770-44d1-84ca-8da7a00a02a1 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.031073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f2013-f770-44d1-84ca-8da7a00a02a1 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.046128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.046835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.047130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.047413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.048735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.049053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.050753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.063879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 38/64] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.069304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.083107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed510d-41a1-4575-894f-b3de1ebc1327 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.093487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c679c51-3ebc-4eb1-abbe-058451c2bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.095172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679c51-3ebc-4eb1-abbe-058451c2bb9c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.095656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679c51-3ebc-4eb1-abbe-058451c2bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.096129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c679c51-3ebc-4eb1-abbe-058451c2bb9c admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.126396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c679c51-3ebc-4eb1-abbe-058451c2bb9c admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.128899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c679c51-3ebc-4eb1-abbe-058451c2bb9c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.130858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 27/65] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.136413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.151257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0058fe3-4b62-4da9-9845-fbda31604113 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.161920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.162576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.162863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.163147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.170463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3954ec4-4166-4735-9da9-3e3d5c30bf7b None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.171021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3954ec4-4166-4735-9da9-3e3d5c30bf7b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.171536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3954ec4-4166-4735-9da9-3e3d5c30bf7b None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.173572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 28/66] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:58:54.179704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.180185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ca78-64f1-4260-84e3-7090d17e328b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.180479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ca78-64f1-4260-84e3-7090d17e328b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.180761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ca78-64f1-4260-84e3-7090d17e328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.182450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.198882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 39/67] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:58:54.203449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6eb7ca78-64f1-4260-84e3-7090d17e328b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:54.204504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.205198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6eb7ca78-64f1-4260-84e3-7090d17e328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:54.214139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 29/68] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:58:54.221310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa3af0-f35b-4126-8a3b-c8483fb6ba54 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.229057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.229935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.230224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.230502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.234015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.236179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.238219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 40/69] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.243601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ca78-64f1-4260-84e3-7090d17e328b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.262033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.263218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ca78-64f1-4260-84e3-7090d17e328b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.267932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69d674-7f9f-4d67-87c6-8be16fe788bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.268594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69d674-7f9f-4d67-87c6-8be16fe788bd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.268888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69d674-7f9f-4d67-87c6-8be16fe788bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.269174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69d674-7f9f-4d67-87c6-8be16fe788bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.270078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69d674-7f9f-4d67-87c6-8be16fe788bd admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=ec47112f539d4d568cb96bfb22dd7bee) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.270397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69d674-7f9f-4d67-87c6-8be16fe788bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.272283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69d674-7f9f-4d67-87c6-8be16fe788bd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.278149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 30/70] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/role_assignments?user.id=ec47112f539d4d568cb96bfb22dd7bee&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=64a2c6a95efd482bb4146a547361d31c => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.293423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57db4f-6138-4b54-81ec-763fbe7b600c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.307258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde50f7d-1207-40e9-8184-cbf7fa8939eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.308079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50f7d-1207-40e9-8184-cbf7fa8939eb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.308372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50f7d-1207-40e9-8184-cbf7fa8939eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.308653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde50f7d-1207-40e9-8184-cbf7fa8939eb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.337631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde50f7d-1207-40e9-8184-cbf7fa8939eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:54.338957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceac5a-7b11-4fd2-86b2-99a9993078a7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.339521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceac5a-7b11-4fd2-86b2-99a9993078a7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.340032 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceac5a-7b11-4fd2-86b2-99a9993078a7 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.342156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 31/71] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:58:54.346007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-fde50f7d-1207-40e9-8184-cbf7fa8939eb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:58:54.346982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfb2b3-8f5f-45e6-83fc-11a39b088323 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.347471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfb2b3-8f5f-45e6-83fc-11a39b088323 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.347597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 41/72] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:54.348068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfb2b3-8f5f-45e6-83fc-11a39b088323 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.350041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 32/73] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:54.354466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfb2b3-8f5f-45e6-83fc-11a39b088323 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.354981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eec14-8cda-498a-8b0e-544aa5979837 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.355288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eec14-8cda-498a-8b0e-544aa5979837 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.355579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eec14-8cda-498a-8b0e-544aa5979837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.374093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfb2b3-8f5f-45e6-83fc-11a39b088323 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.377117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-925eec14-8cda-498a-8b0e-544aa5979837 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:54.378593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-925eec14-8cda-498a-8b0e-544aa5979837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:54.380228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.381122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.381661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.382039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.382915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.383330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.385180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.388859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 42/74] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:54.390604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d66c9e-effb-4b8e-aa9d-c5ab8c1a69fc None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.391065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d66c9e-effb-4b8e-aa9d-c5ab8c1a69fc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.392163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d66c9e-effb-4b8e-aa9d-c5ab8c1a69fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.395320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 33/75] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.401772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.415456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02255f81-0012-4a89-90e8-95dd3a6f45e5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.418304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-28d66c9e-effb-4b8e-aa9d-c5ab8c1a69fc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:54.419957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-28d66c9e-effb-4b8e-aa9d-c5ab8c1a69fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:54.420575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.421695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.422422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.422959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] PATH_INFO: `/v3/users/11bc38186327459cb57d952300827ad5` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.424554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] RBAC: Authorizing `identity:get_user(user_id=11bc38186327459cb57d952300827ad5)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.426848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.433310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 34/76] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/users/11bc38186327459cb57d952300827ad5 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:54.433310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.437867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 43/77] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:54.440060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d66c9e-effb-4b8e-aa9d-c5ab8c1a69fc None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.444434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f479-3a4a-4824-a173-78f8da04bca5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.449588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.450654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.450941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.451218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.453234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d66c9e-effb-4b8e-aa9d-c5ab8c1a69fc None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.459263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.460729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.461613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.462145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.464584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:54.472146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.473770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:58:54.474665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.475686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 35/78] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:54.481259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.490530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 44/79] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:58:54.496248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.503718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5f56-3c18-4542-b6b9-dce2d975da41 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.505794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f344-0304-4d50-a019-edf99e34bfea admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.508435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.509151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.509542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.509822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.510587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.510892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.511859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.512644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.513081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.513618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.514340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.526288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 36/80] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:54.527173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:54.527281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.534301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:58:54.535508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 45/81] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:54.536287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.537018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1f3d-2f88-4d39-8e3f-641e2d5acd1c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.546099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.546945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.547225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.547329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e599d1-173c-4ac2-b73f-932c42926dac admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.548037 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.549250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.551362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.552751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.553290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 37/82] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.553812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.554057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.557616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.557903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.559628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.561786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.563589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 46/83] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.564204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.571948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23baa-d1fb-4321-91d1-55bcfe7ea515 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.576795 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.577726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.578066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655613-a172-450b-874a-45bc8a880d85 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.578442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.579456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.580485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.581008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.582843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.583465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.584244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.584531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.584983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.586174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=11bc38186327459cb57d952300827ad5) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.586676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.588677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.593315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 38/84] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.594416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.598653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 47/85] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/role_assignments?user.id=11bc38186327459cb57d952300827ad5&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.604264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.617314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa09ff9-e9b0-4d77-a36b-029dccf873ca admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.621136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244e561-b794-4205-8f60-115ded762977 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.628259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.629329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.629827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.630311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.637221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.638524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.639013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.639494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.642738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.645202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.647520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 48/86] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.651720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.652791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.661315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.675470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 39/87] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:58:54.679416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a33d3c-c5a5-4cfb-aa31-5f4a2960e46f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.680553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.696113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.696832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.697170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.697527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.705616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d8bd6-6ebc-4378-a00b-217292fee637 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.716245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.717216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.720225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.720562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.720851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.721541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.724221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.728954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.731306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 40/88] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:54.737725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 49/89] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:58:54.738554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.744608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.754146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11182a47-0af6-4c35-b456-b617e18ca839 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.760297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e39799-8199-4944-b8af-5998f6d0ffc3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.765508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd4389-7191-4b3c-ba5c-cf47c739d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.765668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403aeaa-9f47-477b-b095-9d6c244d7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.766812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd4389-7191-4b3c-ba5c-cf47c739d3df admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.767011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403aeaa-9f47-477b-b095-9d6c244d7fee admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.767130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd4389-7191-4b3c-ba5c-cf47c739d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.767358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403aeaa-9f47-477b-b095-9d6c244d7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.767454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd4389-7191-4b3c-ba5c-cf47c739d3df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.767644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403aeaa-9f47-477b-b095-9d6c244d7fee admin admin] PATH_INFO: `/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.768305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd4389-7191-4b3c-ba5c-cf47c739d3df admin admin] RBAC: Adding query filter params (role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=ec47112f539d4d568cb96bfb22dd7bee) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.768625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd4389-7191-4b3c-ba5c-cf47c739d3df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.768925 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403aeaa-9f47-477b-b095-9d6c244d7fee admin admin] RBAC: Authorizing `identity:get_project(project_id=1adf81bdb9c942c1bbf8e985c7b74e4d)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.770611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd4389-7191-4b3c-ba5c-cf47c739d3df admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.771041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403aeaa-9f47-477b-b095-9d6c244d7fee admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.772792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 50/90] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.774553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8500-8718-4056-b5bc-c14197bcfaa2 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.774553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8500-8718-4056-b5bc-c14197bcfaa2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.774872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8500-8718-4056-b5bc-c14197bcfaa2 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.776819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 51/91] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:54.778271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8500-8718-4056-b5bc-c14197bcfaa2 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.781709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 41/92] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/role_assignments?user.id=ec47112f539d4d568cb96bfb22dd7bee&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.783797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe2e3-3d8b-4925-9b61-698f836ed9f6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.784141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe2e3-3d8b-4925-9b61-698f836ed9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.784427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe2e3-3d8b-4925-9b61-698f836ed9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.792978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8500-8718-4056-b5bc-c14197bcfaa2 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.797694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.798366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.798653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.799451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.799789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=1adf81bdb9c942c1bbf8e985c7b74e4d, user.id=ec47112f539d4d568cb96bfb22dd7bee) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:54.800106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.802123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.805016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-4a8fe2e3-3d8b-4925-9b61-698f836ed9f6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:54.806404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4a8fe2e3-3d8b-4925-9b61-698f836ed9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:54.808684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 52/93] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/role_assignments?user.id=ec47112f539d4d568cb96bfb22dd7bee&scope.project.id=1adf81bdb9c942c1bbf8e985c7b74e4d&role.id=64a2c6a95efd482bb4146a547361d31c => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.822187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 42/94] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:58:54.848720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.859387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ee0e-b734-4472-bc19-ab7578ac6cb1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.864252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b123526-b859-4ff0-9ee3-eac2acd45b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.865083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b123526-b859-4ff0-9ee3-eac2acd45b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.865402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b123526-b859-4ff0-9ee3-eac2acd45b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.865688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b123526-b859-4ff0-9ee3-eac2acd45b85 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.867035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b123526-b859-4ff0-9ee3-eac2acd45b85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.868858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b123526-b859-4ff0-9ee3-eac2acd45b85 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.870650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 53/95] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:54.876462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fe2e3-3d8b-4925-9b61-698f836ed9f6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:54.891819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fe2e3-3d8b-4925-9b61-698f836ed9f6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:54.897238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc1f3a-c5ef-4f2a-84f5-500d6ba0a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:54.898276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1f3a-c5ef-4f2a-84f5-500d6ba0a157 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:54.898778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1f3a-c5ef-4f2a-84f5-500d6ba0a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:54.899293 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc1f3a-c5ef-4f2a-84f5-500d6ba0a157 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:54.900290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc1f3a-c5ef-4f2a-84f5-500d6ba0a157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:54.901675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-7cdc1f3a-c5ef-4f2a-84f5-500d6ba0a157 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:54.901675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:58:54.901675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:58:54.903513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc1f3a-c5ef-4f2a-84f5-500d6ba0a157 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:54.996297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 43/96] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:58:54 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:58:56.810013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed640-ce17-426c-b8bd-e4eae97394b9 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:56.810591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed640-ce17-426c-b8bd-e4eae97394b9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:56.810591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ed640-ce17-426c-b8bd-e4eae97394b9 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:56.812494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 54/97] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:56.822335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142d3a8-1d38-4a40-89b6-d5a0901d4fcb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:56.822807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142d3a8-1d38-4a40-89b6-d5a0901d4fcb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:56.822900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142d3a8-1d38-4a40-89b6-d5a0901d4fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:56.850294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b142d3a8-1d38-4a40-89b6-d5a0901d4fcb None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:56.851495 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b142d3a8-1d38-4a40-89b6-d5a0901d4fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:56.865014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 44/98] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:56.900888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ed640-ce17-426c-b8bd-e4eae97394b9 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:56.914884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ed640-ce17-426c-b8bd-e4eae97394b9 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:56.919581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:56.920617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:56.921111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:56.921632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:56.932520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:56.939730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:58:56.945404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 55/99] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:56.950656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142d3a8-1d38-4a40-89b6-d5a0901d4fcb None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:56.957263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142d3a8-1d38-4a40-89b6-d5a0901d4fcb None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:56.962603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:56.963486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:56.963958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:56.964423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:56.965459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:56.965957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:56.968029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:56.977471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 45/100] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:56.985934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.002863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d734d-b716-49ef-bc6a-1651fdbcf3f7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.007750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.008848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.009356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.009822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.011318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:57.013687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:57.015601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 56/101] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:56 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:57.021830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.032586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29123b1-ba96-409b-827b-4ecb7dedd063 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.040990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb5fb3-18be-48ec-9f1a-78f3c30ba198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.042092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5fb3-18be-48ec-9f1a-78f3c30ba198 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.042553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5fb3-18be-48ec-9f1a-78f3c30ba198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.043020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5fb3-18be-48ec-9f1a-78f3c30ba198 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.044428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb5fb3-18be-48ec-9f1a-78f3c30ba198 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:57.046726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb5fb3-18be-48ec-9f1a-78f3c30ba198 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:57.048627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 46/102] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:57.054310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.065179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e303094-ed94-41b6-ae79-a97740ab5c59 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.074934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15005406-ea98-4da1-ab7e-5290f392a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.076076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005406-ea98-4da1-ab7e-5290f392a931 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.076562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005406-ea98-4da1-ab7e-5290f392a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.077024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15005406-ea98-4da1-ab7e-5290f392a931 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613/users/ec47112f539d4d568cb96bfb22dd7bee/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.079760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005406-ea98-4da1-ab7e-5290f392a931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88c14381f143b8800eac20d6950613, user_id=ec47112f539d4d568cb96bfb22dd7bee, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:57.082781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15005406-ea98-4da1-ab7e-5290f392a931 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:57.178891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 57/103] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:58:57 2022] PUT /identity/v3/projects/3e88c14381f143b8800eac20d6950613/users/ec47112f539d4d568cb96bfb22dd7bee/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:58:57.456411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0ec7-0161-4242-9ded-4e02176ef664 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.457084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0ec7-0161-4242-9ded-4e02176ef664 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.457611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0ec7-0161-4242-9ded-4e02176ef664 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.459654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 47/104] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:57.477585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d433b4-d1ce-4c88-b974-aa3026d7d78a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.478201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d433b4-d1ce-4c88-b974-aa3026d7d78a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.478689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d433b4-d1ce-4c88-b974-aa3026d7d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.501660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-12d433b4-d1ce-4c88-b974-aa3026d7d78a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:57.503185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-12d433b4-d1ce-4c88-b974-aa3026d7d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:57.582629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 58/105] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:57.625586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0ec7-0161-4242-9ded-4e02176ef664 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.645781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0ec7-0161-4242-9ded-4e02176ef664 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.650765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.651782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.652283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.652797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.669166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:57.676897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:58:57.678431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 48/106] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:57.684306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d433b4-d1ce-4c88-b974-aa3026d7d78a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.693502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d433b4-d1ce-4c88-b974-aa3026d7d78a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.704837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3711d8c-ec1f-4f35-a111-31c85afaee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.705557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711d8c-ec1f-4f35-a111-31c85afaee6e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.705847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711d8c-ec1f-4f35-a111-31c85afaee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.706125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3711d8c-ec1f-4f35-a111-31c85afaee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.706957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711d8c-ec1f-4f35-a111-31c85afaee6e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:57.707215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711d8c-ec1f-4f35-a111-31c85afaee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:57.708832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3711d8c-ec1f-4f35-a111-31c85afaee6e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:57.720707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 59/107] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:57.726652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.742476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c75bb1-4938-4e87-bff9-09013e927f68 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.751143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.752040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.752330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.752608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.753973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:57.756218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:57.758012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 49/108] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:57.762018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0a23b-6207-479a-8822-14312a5fcaa3 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.762314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0a23b-6207-479a-8822-14312a5fcaa3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.762606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0a23b-6207-479a-8822-14312a5fcaa3 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.764664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 60/109] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:57.765903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.771187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b979-a87d-4be0-9e2d-1f90df7e5116 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.771499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b979-a87d-4be0-9e2d-1f90df7e5116 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.771761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b979-a87d-4be0-9e2d-1f90df7e5116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.798605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8409a-4fa4-4218-ba03-f973bd73e1fa admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.803404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ba01b979-a87d-4be0-9e2d-1f90df7e5116 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:57.804599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ba01b979-a87d-4be0-9e2d-1f90df7e5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:57.810495 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0941e-f57d-4bd5-af0e-5d3da0804be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.811362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0941e-f57d-4bd5-af0e-5d3da0804be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.811652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0941e-f57d-4bd5-af0e-5d3da0804be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.811935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0941e-f57d-4bd5-af0e-5d3da0804be2 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.813687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0941e-f57d-4bd5-af0e-5d3da0804be2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:57.815769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0941e-f57d-4bd5-af0e-5d3da0804be2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:57.817477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 50/110] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:57.818648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5761e-7df1-4cef-b027-17e114c250b4 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.818938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5761e-7df1-4cef-b027-17e114c250b4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.819222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5761e-7df1-4cef-b027-17e114c250b4 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.820836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 51/111] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:57.826415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5761e-7df1-4cef-b027-17e114c250b4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.831454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 61/112] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:58:57.831845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd59209-8349-49b7-9813-2b6bc0ff2c49 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.832011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd59209-8349-49b7-9813-2b6bc0ff2c49 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.832262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd59209-8349-49b7-9813-2b6bc0ff2c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.853625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5761e-7df1-4cef-b027-17e114c250b4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.861071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-dfd59209-8349-49b7-9813-2b6bc0ff2c49 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:57.862304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dfd59209-8349-49b7-9813-2b6bc0ff2c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:57.864543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.865457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.865746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.866028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613/users/ec47112f539d4d568cb96bfb22dd7bee/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.868307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88c14381f143b8800eac20d6950613, user_id=ec47112f539d4d568cb96bfb22dd7bee, role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:57.869376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:58:57.869376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:58:57.869376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:58:57.871459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:57.882092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 62/113] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:57.882799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd59209-8349-49b7-9813-2b6bc0ff2c49 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.898564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd59209-8349-49b7-9813-2b6bc0ff2c49 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.903783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.904622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.904938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.905484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.918440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:57.925673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:58:57.927392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 63/114] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:57.928495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.939084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529e72a-e3c0-43d6-81a8-c5aab2ab4846 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:57.943977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:57.945053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:57.946005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:57.946499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:57.958187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:57.966389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:58:57.968288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 64/115] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:57.969920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.975271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 52/116] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:58:57 2022] PUT /identity/v3/projects/3e88c14381f143b8800eac20d6950613/users/ec47112f539d4d568cb96bfb22dd7bee/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:58:57.977104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:57.986966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a1aee-7b8d-4176-b0a3-d30be9eda26e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.069098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.070138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.070608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.071060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.072033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:58.072525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.074458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.093461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 65/117] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:58.100500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:58.120841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909280a-8ca5-40b7-90cb-1257e8428bf3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.129569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.131494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.131970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.132432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] PATH_INFO: `/v3/users/11bc38186327459cb57d952300827ad5` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.133956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] RBAC: Authorizing `identity:get_user(user_id=11bc38186327459cb57d952300827ad5)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.136057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.138168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 66/118] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:58 2022] GET /identity/v3/users/11bc38186327459cb57d952300827ad5 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:58.144386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:58.160110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275236e5-6969-4aa6-97ad-7be8af2973ed admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.167429 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337a28f-76f2-4c88-8f85-028ec6bbc1dd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.182581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.183224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.183341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.183607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.183891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.184696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:58.184991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.185141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.185774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.186260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.186664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.187871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.190991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.198875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 67/119] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:58 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:58.205449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:58.215446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 53/120] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:58:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:58.221905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:58.224182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44af1d-56d7-42b3-aa8a-87dd2fa77785 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.231160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecdb97-5fcf-4e1d-be10-8db09a75ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.232368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdb97-5fcf-4e1d-be10-8db09a75ced1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.232798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdb97-5fcf-4e1d-be10-8db09a75ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.233227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecdb97-5fcf-4e1d-be10-8db09a75ced1 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613/users/11bc38186327459cb57d952300827ad5/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.236394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecdb97-5fcf-4e1d-be10-8db09a75ced1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88c14381f143b8800eac20d6950613, user_id=11bc38186327459cb57d952300827ad5, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.245161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecdb97-5fcf-4e1d-be10-8db09a75ced1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.252602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90788640-864f-4dd2-83e5-05778dc74485 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.261988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.262906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.263201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.263483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.267778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.270046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.272883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 54/121] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:58 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:58:58.285746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:58.306368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c751fee-1e75-4485-84d0-f42f489e267a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.318734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.319138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.319425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.319766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] PATH_INFO: `/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.323969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] RBAC: Authorizing `identity:get_project(project_id=1adf81bdb9c942c1bbf8e985c7b74e4d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.326196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.328109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 55/122] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:58 2022] GET /identity/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:58.334055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:58.344523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beaf48-2059-44b4-8d3e-0ae96c41f86c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:58.350264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe62a24-de2e-4f4e-9b4c-3ddcf7e919c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:58.351146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62a24-de2e-4f4e-9b4c-3ddcf7e919c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:58.351436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62a24-de2e-4f4e-9b4c-3ddcf7e919c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:58.351713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62a24-de2e-4f4e-9b4c-3ddcf7e919c5 admin admin] PATH_INFO: `/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d/users/ec47112f539d4d568cb96bfb22dd7bee/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:58.354917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe62a24-de2e-4f4e-9b4c-3ddcf7e919c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adf81bdb9c942c1bbf8e985c7b74e4d, user_id=ec47112f539d4d568cb96bfb22dd7bee, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:58.357625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe62a24-de2e-4f4e-9b4c-3ddcf7e919c5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:58.368214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 68/123] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:58:58 2022] PUT /identity/v3/projects/3e88c14381f143b8800eac20d6950613/users/11bc38186327459cb57d952300827ad5/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 03:58:58.424334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 56/124] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:58:58 2022] PUT /identity/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d/users/ec47112f539d4d568cb96bfb22dd7bee/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 03:58:59.113404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368fc5b-5d33-4d94-93b7-5f5d13e340d2 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.114469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368fc5b-5d33-4d94-93b7-5f5d13e340d2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.114982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368fc5b-5d33-4d94-93b7-5f5d13e340d2 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.117368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 69/125] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:59.123266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a5566-98f4-4ba0-941f-88fa3eb53633 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.123724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a5566-98f4-4ba0-941f-88fa3eb53633 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.123910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a5566-98f4-4ba0-941f-88fa3eb53633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.145833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-7e5a5566-98f4-4ba0-941f-88fa3eb53633 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:59.147074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7e5a5566-98f4-4ba0-941f-88fa3eb53633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:59.214229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 57/126] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:59.237832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368fc5b-5d33-4d94-93b7-5f5d13e340d2 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.250156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368fc5b-5d33-4d94-93b7-5f5d13e340d2 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.254570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.255349 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.255636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.255915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.267454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:58:59.274271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:58:59.284864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 70/127] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:58:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:58:59.290535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a5566-98f4-4ba0-941f-88fa3eb53633 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.300247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a5566-98f4-4ba0-941f-88fa3eb53633 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.304785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.305487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.305775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.306054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.306818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:59.307127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:59.308767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:59.317416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 58/128] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:58:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:59.322910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.333186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e1cc-061d-4f9e-a409-5d333db50bd1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.337919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.338772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.339059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.339338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] PATH_INFO: `/v3/users/39f804e30e8748b7ab9e4770429a5a8a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.353529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] RBAC: Authorizing `identity:get_user(user_id=39f804e30e8748b7ab9e4770429a5a8a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:59.355715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:59.357360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 71/129] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:58:59 2022] GET /identity/v3/users/39f804e30e8748b7ab9e4770429a5a8a => generated 289 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:59.363010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.373004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76439c6-ab7a-4fb7-bfad-05042d49e08f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.377640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.378412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.378770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.379119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.387304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:59.389268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:59.398786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 59/130] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:58:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:58:59.404433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.414745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9d98-4502-4289-80eb-5528fe178166 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.419308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d7243-a4f5-49e6-bb0f-ba39386e2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.420234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7243-a4f5-49e6-bb0f-ba39386e2ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.420592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7243-a4f5-49e6-bb0f-ba39386e2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.420945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7243-a4f5-49e6-bb0f-ba39386e2ff4 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.422289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d7243-a4f5-49e6-bb0f-ba39386e2ff4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:59.424422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d7243-a4f5-49e6-bb0f-ba39386e2ff4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:59.426311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 72/131] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:58:59 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:59.432228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.442102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07e8cb-ba92-4cbc-99e0-2fae33a379f5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.446817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eea26e-950d-482f-872a-efab89b0dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.447533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eea26e-950d-482f-872a-efab89b0dbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.447894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eea26e-950d-482f-872a-efab89b0dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.448248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eea26e-950d-482f-872a-efab89b0dbe4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.449225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eea26e-950d-482f-872a-efab89b0dbe4 admin admin] RBAC: Adding query filter params (role.id=0a193e6ac39c40ba875fedca1d23e212, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=39f804e30e8748b7ab9e4770429a5a8a) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:58:59.449645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eea26e-950d-482f-872a-efab89b0dbe4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:59.451717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eea26e-950d-482f-872a-efab89b0dbe4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:59.457620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 60/132] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:58:59 2022] GET /identity/v3/role_assignments?user.id=39f804e30e8748b7ab9e4770429a5a8a&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=0a193e6ac39c40ba875fedca1d23e212 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:59.481692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6af57-6345-4cd8-96c9-e31001c1cdf4 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.481967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6af57-6345-4cd8-96c9-e31001c1cdf4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.482308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6af57-6345-4cd8-96c9-e31001c1cdf4 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.484117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 73/133] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:58:59.490622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e718ee-4823-4ed2-a24f-791404184f0a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.491014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e718ee-4823-4ed2-a24f-791404184f0a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.491365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e718ee-4823-4ed2-a24f-791404184f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.510967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-d4e718ee-4823-4ed2-a24f-791404184f0a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:58:59.512287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d4e718ee-4823-4ed2-a24f-791404184f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:58:59.520607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 61/134] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:58:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:58:59.544966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6af57-6345-4cd8-96c9-e31001c1cdf4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.559036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6af57-6345-4cd8-96c9-e31001c1cdf4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.563840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b728ca-6c69-459a-bd3e-92cc62581ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.564737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b728ca-6c69-459a-bd3e-92cc62581ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.565117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b728ca-6c69-459a-bd3e-92cc62581ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.565495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b728ca-6c69-459a-bd3e-92cc62581ff9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.566850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b728ca-6c69-459a-bd3e-92cc62581ff9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:59.568731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b728ca-6c69-459a-bd3e-92cc62581ff9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:59.570665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 74/135] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:58:59.576372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e718ee-4823-4ed2-a24f-791404184f0a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:58:59.586323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e718ee-4823-4ed2-a24f-791404184f0a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:58:59.591094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ad48d-cf09-480f-9a6d-de47bdf7d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:58:59.591821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ad48d-cf09-480f-9a6d-de47bdf7d6ee admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:58:59.592103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ad48d-cf09-480f-9a6d-de47bdf7d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:58:59.592378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ad48d-cf09-480f-9a6d-de47bdf7d6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:58:59.593167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ad48d-cf09-480f-9a6d-de47bdf7d6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:58:59.595822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ad48d-cf09-480f-9a6d-de47bdf7d6ee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:58:59.749215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 62/136] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 03:58:59 2022] POST /identity/v3/projects => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:00.615686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9527-56f2-4c47-b211-900e77db26ba None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:00.616193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9527-56f2-4c47-b211-900e77db26ba None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:00.616290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9527-56f2-4c47-b211-900e77db26ba None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:00.618225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 75/137] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:00.635184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee19b4-251f-4be2-a7d5-a3c4bed42f84 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:00.635635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee19b4-251f-4be2-a7d5-a3c4bed42f84 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:00.635813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee19b4-251f-4be2-a7d5-a3c4bed42f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:00.658258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-29ee19b4-251f-4be2-a7d5-a3c4bed42f84 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:00.659455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-29ee19b4-251f-4be2-a7d5-a3c4bed42f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:00.726961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 63/138] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:00.771884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9527-56f2-4c47-b211-900e77db26ba None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:00.787248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9527-56f2-4c47-b211-900e77db26ba None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:00.797892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:00.798702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:00.798988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:00.799266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:00.816740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:00.823520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:00.824710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 76/139] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:00.831267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee19b4-251f-4be2-a7d5-a3c4bed42f84 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:00.844879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee19b4-251f-4be2-a7d5-a3c4bed42f84 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:00.850666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:00.851336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:00.851621 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:00.851893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:00.852660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:00.852963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:00.856264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:00.867913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 64/140] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:00.876197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:00.891594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe34a21-6e68-4a37-9015-ff8a792e5faf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:00.897927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:00.898780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:00.899094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:00.899349 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:00.900616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:00.902880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:00.904522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 77/141] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:00 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:00.916572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:00.926423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0420654-0b57-408b-9475-03596cf99bba admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:00.937441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:00.938402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:00.938910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:00.939405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:00.956934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:00.959027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:00.975293 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 65/142] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:00.980908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:00.995507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fbad7-21ad-4dc9-a626-a4a0a469eb0b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:01.005492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee06fc1-de48-46b7-986c-6ebede1ddda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:01.006418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee06fc1-de48-46b7-986c-6ebede1ddda6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.006693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee06fc1-de48-46b7-986c-6ebede1ddda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.006962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee06fc1-de48-46b7-986c-6ebede1ddda6 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.008189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee06fc1-de48-46b7-986c-6ebede1ddda6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:01.010413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee06fc1-de48-46b7-986c-6ebede1ddda6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:01.012199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 78/143] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:00 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:01.018301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:01.030201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd17b5-f25f-47ad-99b1-987201763d55 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:01.041429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002291da-c68c-4135-8a7a-f95650ca95c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:01.042336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002291da-c68c-4135-8a7a-f95650ca95c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.042829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002291da-c68c-4135-8a7a-f95650ca95c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.043288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002291da-c68c-4135-8a7a-f95650ca95c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.044321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002291da-c68c-4135-8a7a-f95650ca95c4 admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=ec47112f539d4d568cb96bfb22dd7bee) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:01.044827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002291da-c68c-4135-8a7a-f95650ca95c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:01.046925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002291da-c68c-4135-8a7a-f95650ca95c4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:01.057882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 66/144] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:01 2022] GET /identity/v3/role_assignments?user.id=ec47112f539d4d568cb96bfb22dd7bee&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=64a2c6a95efd482bb4146a547361d31c => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:01.732479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce04d0-d47c-48a9-a6f2-70a30c7dd0a3 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.733004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce04d0-d47c-48a9-a6f2-70a30c7dd0a3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.733446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce04d0-d47c-48a9-a6f2-70a30c7dd0a3 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.736269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 79/145] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:01.742514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e93e-5af1-4e06-a8f5-257c948bc530 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.742968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e93e-5af1-4e06-a8f5-257c948bc530 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.743066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e93e-5af1-4e06-a8f5-257c948bc530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.763454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb4c5-b938-4da0-a557-196ee0a594c8 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.763740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb4c5-b938-4da0-a557-196ee0a594c8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.764016 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb4c5-b938-4da0-a557-196ee0a594c8 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.765797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 80/146] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:01.771858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd58c-1cc3-4b00-a168-83d5b0cd41df None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.771858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd58c-1cc3-4b00-a168-83d5b0cd41df None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.772110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cd58c-1cc3-4b00-a168-83d5b0cd41df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.781574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-06a7e93e-5af1-4e06-a8f5-257c948bc530 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:01.783351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-06a7e93e-5af1-4e06-a8f5-257c948bc530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:01.801376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 67/147] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:01.814495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-265cd58c-1cc3-4b00-a168-83d5b0cd41df None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:01.815690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-265cd58c-1cc3-4b00-a168-83d5b0cd41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:01.839193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 81/148] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:01.873386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e93e-5af1-4e06-a8f5-257c948bc530 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:01.876697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cd58c-1cc3-4b00-a168-83d5b0cd41df None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:01.883274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e93e-5af1-4e06-a8f5-257c948bc530 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:01.894468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:01.895759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cd58c-1cc3-4b00-a168-83d5b0cd41df None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:01.896213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.896964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.897600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.911827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:01.912657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.912940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.913265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.922363 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:01.932105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:01.933531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 68/149] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:01.940371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:01.946227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:01.950985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc323487-79e9-4d57-8ad4-db850b76a19e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:01.953452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:01.954701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 82/150] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:01.957466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:01.957466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.957466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.958065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.959074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:01.959574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:01.961248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:01.962188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:01.974419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 69/151] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:01.980421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:01.981305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717114e9-72d9-4eb7-8de0-76f4bbcdf14c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:01.992181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedec1e7-3927-43af-90b4-2d3e77155c82 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:01.994797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:01.995468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:01.995744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:01.996015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:01.996781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:01.997089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:01.998572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:01.998704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:01.999821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.000572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.001035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.002560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.005016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.007445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 70/152] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:01 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:02.013797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.023494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 83/153] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:02.025044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32fc9b-afda-4b9c-9a9d-a3d3badd194e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.028582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.030352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.031231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.031755 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.032258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.041144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.043365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.058682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64a0b-1f78-4606-949a-9ebf982b7f76 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.059017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 71/154] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:02.060519 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.070122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b16633-8505-406b-be2e-cab33db084eb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.073171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.074077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.074434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.074734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] PATH_INFO: `/v3/users/ec47112f539d4d568cb96bfb22dd7bee` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.076010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] RBAC: Authorizing `identity:get_user(user_id=ec47112f539d4d568cb96bfb22dd7bee)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.076249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.077354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.077879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.078179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.079092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] PATH_INFO: `/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.080301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 84/155] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/users/ec47112f539d4d568cb96bfb22dd7bee => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:02.080743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1adf81bdb9c942c1bbf8e985c7b74e4d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.083203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.085844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 72/156] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/projects/1adf81bdb9c942c1bbf8e985c7b74e4d => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:02.090199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.091974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.102333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d73f44-05eb-4439-b539-03df9154dad6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.107985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d531-07d2-4b6c-8138-14927de697ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.108874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d531-07d2-4b6c-8138-14927de697ac admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.109409 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d531-07d2-4b6c-8138-14927de697ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.110535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d531-07d2-4b6c-8138-14927de697ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.111611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d531-07d2-4b6c-8138-14927de697ac admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=1adf81bdb9c942c1bbf8e985c7b74e4d, user.id=ec47112f539d4d568cb96bfb22dd7bee) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:02.112106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d531-07d2-4b6c-8138-14927de697ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.114300 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d531-07d2-4b6c-8138-14927de697ac admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.115390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcaaa7-4e56-4d96-b08e-52ba2d308691 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.121070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 73/157] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/role_assignments?user.id=ec47112f539d4d568cb96bfb22dd7bee&scope.project.id=1adf81bdb9c942c1bbf8e985c7b74e4d&role.id=64a2c6a95efd482bb4146a547361d31c => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:02.131859 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a469b-1e12-4379-8534-65629b93e7c0 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.132240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a469b-1e12-4379-8534-65629b93e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.133064 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a469b-1e12-4379-8534-65629b93e7c0 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.135160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 74/158] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:02.140029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.141629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a8be3-62f4-4fe0-84cf-d9291e65cab1 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.141994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a8be3-62f4-4fe0-84cf-d9291e65cab1 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.142326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.142449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a8be3-62f4-4fe0-84cf-d9291e65cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.142906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.143353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.166196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.170481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.181004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-108a8be3-62f4-4fe0-84cf-d9291e65cab1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:02.184621 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-108a8be3-62f4-4fe0-84cf-d9291e65cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:02.190110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 85/159] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:02.196028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.202526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 75/160] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:02.213752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254300e-1fb0-4e6d-a127-dfa4e5a27f0b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.221896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.223092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.223552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.223999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.225767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.228249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.230405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 86/161] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:02.237134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a8be3-62f4-4fe0-84cf-d9291e65cab1 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.250327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a8be3-62f4-4fe0-84cf-d9291e65cab1 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.262147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.263162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.263587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.263998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.265073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] RBAC: Adding query filter params (role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=ec47112f539d4d568cb96bfb22dd7bee) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:02.265581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.267783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.276813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.280725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524289f-fbe8-4efd-95df-ad1ced466c20 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.291400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 76/162] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/role_assignments?user.id=ec47112f539d4d568cb96bfb22dd7bee&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:02.294232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.295286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.295713 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.296150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.309819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:02.317246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:02.318745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 87/163] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:02.326598 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.339341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fd709-7000-46b7-9416-fbcc4cd81838 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.344618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.345612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.346030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.346439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.347438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:02.347884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.349874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.359619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 77/164] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:02.365792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.377150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe9514-3ce6-41db-b48f-da86909511a7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.382383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.383562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.384018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.384428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] PATH_INFO: `/v3/users/11bc38186327459cb57d952300827ad5` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.386191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] RBAC: Authorizing `identity:get_user(user_id=11bc38186327459cb57d952300827ad5)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.388269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.390192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 88/165] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/users/11bc38186327459cb57d952300827ad5 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:02.398506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.409478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c795c-6efa-4c3d-bb3b-484cfbb6d34c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.415921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.416864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.417313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.417749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.427261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.429464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.440494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 78/166] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:02.446194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.456832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b292f28-5de0-47c2-86e6-ccca378f82bb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.462097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4eebf7-43d1-47fb-afe2-38d0f3e12860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.463290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eebf7-43d1-47fb-afe2-38d0f3e12860 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.463737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eebf7-43d1-47fb-afe2-38d0f3e12860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.464178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4eebf7-43d1-47fb-afe2-38d0f3e12860 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.465647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eebf7-43d1-47fb-afe2-38d0f3e12860 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.467911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4eebf7-43d1-47fb-afe2-38d0f3e12860 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.470473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 89/167] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:02.476368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.486298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e12f1d-2aa2-4261-a3b8-3d12b8d06860 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.492250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383dc3e-bd7b-4457-bb88-e793c7b8e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.493184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383dc3e-bd7b-4457-bb88-e793c7b8e9ff admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.493703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383dc3e-bd7b-4457-bb88-e793c7b8e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.494127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383dc3e-bd7b-4457-bb88-e793c7b8e9ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.495221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383dc3e-bd7b-4457-bb88-e793c7b8e9ff admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=11bc38186327459cb57d952300827ad5) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:02.495674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383dc3e-bd7b-4457-bb88-e793c7b8e9ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.497836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383dc3e-bd7b-4457-bb88-e793c7b8e9ff admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.505812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 79/168] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/role_assignments?user.id=11bc38186327459cb57d952300827ad5&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:02.556010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b07ae-24c4-4f24-a975-2a74bdcb87ef None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.556511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b07ae-24c4-4f24-a975-2a74bdcb87ef None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.556945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b07ae-24c4-4f24-a975-2a74bdcb87ef None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.559146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 90/169] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:02.565736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a535-425e-4579-87fa-8e808732cc6a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.566179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a535-425e-4579-87fa-8e808732cc6a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.566560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0a535-425e-4579-87fa-8e808732cc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.586419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-46d0a535-425e-4579-87fa-8e808732cc6a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:02.587815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-46d0a535-425e-4579-87fa-8e808732cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:02.596770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 80/170] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:02.620018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b07ae-24c4-4f24-a975-2a74bdcb87ef None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.637518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b07ae-24c4-4f24-a975-2a74bdcb87ef None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.644543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.645797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.646217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.646626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.659064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:02.666375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:02.668179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 91/171] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:02.674041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a535-425e-4579-87fa-8e808732cc6a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.683515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0a535-425e-4579-87fa-8e808732cc6a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.688675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.689497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.689890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.690340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.691124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:02.691538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.693260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.702333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 81/172] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:02.708528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.719407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f11fd-398b-4f8a-8f0b-ed9dd8b8c338 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.723948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.724801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.725081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.725417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] PATH_INFO: `/v3/users/39f804e30e8748b7ab9e4770429a5a8a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.726643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=39f804e30e8748b7ab9e4770429a5a8a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.728780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.730428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 92/173] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/users/39f804e30e8748b7ab9e4770429a5a8a => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:02.736101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.746052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f84b5-4771-4812-ae54-5582ea2030ed admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.751041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3acd07-27c3-4c14-983a-6ee4e45d6d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.751894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3acd07-27c3-4c14-983a-6ee4e45d6d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.752176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3acd07-27c3-4c14-983a-6ee4e45d6d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.752451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3acd07-27c3-4c14-983a-6ee4e45d6d4e admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.753694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3acd07-27c3-4c14-983a-6ee4e45d6d4e admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.755786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3acd07-27c3-4c14-983a-6ee4e45d6d4e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.757896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 82/174] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:02 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:02.763343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:02.774977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845765ef-4d95-449d-b359-37e543d5e4d6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:02.779367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733ea1b-bf9e-4436-a064-34fd2350b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:02.780233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733ea1b-bf9e-4436-a064-34fd2350b075 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:02.780517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733ea1b-bf9e-4436-a064-34fd2350b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:02.780792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733ea1b-bf9e-4436-a064-34fd2350b075 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613/users/39f804e30e8748b7ab9e4770429a5a8a/roles/0a193e6ac39c40ba875fedca1d23e212` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:02.782837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733ea1b-bf9e-4436-a064-34fd2350b075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88c14381f143b8800eac20d6950613, user_id=39f804e30e8748b7ab9e4770429a5a8a, role_id=0a193e6ac39c40ba875fedca1d23e212)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:02.785615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733ea1b-bf9e-4436-a064-34fd2350b075 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:02.867470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 93/175] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:02 2022] PUT /identity/v3/projects/3e88c14381f143b8800eac20d6950613/users/39f804e30e8748b7ab9e4770429a5a8a/roles/0a193e6ac39c40ba875fedca1d23e212 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:03.117172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514c775-b217-45d7-bb2d-23b0fea643de None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:03.117502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514c775-b217-45d7-bb2d-23b0fea643de None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:03.117771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514c775-b217-45d7-bb2d-23b0fea643de None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:03.119546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 83/176] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:03.124640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8816706-3b54-4de9-a8ef-0930054e3e4f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:03.125019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8816706-3b54-4de9-a8ef-0930054e3e4f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:03.125390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8816706-3b54-4de9-a8ef-0930054e3e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:03.143086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e8816706-3b54-4de9-a8ef-0930054e3e4f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:03.144258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e8816706-3b54-4de9-a8ef-0930054e3e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:03.199522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 94/177] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:03.224198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514c775-b217-45d7-bb2d-23b0fea643de None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:03.236223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514c775-b217-45d7-bb2d-23b0fea643de None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:03.240438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6091e-f3e3-4100-9f04-2dd59ee9309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:03.241203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6091e-f3e3-4100-9f04-2dd59ee9309e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:03.241518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6091e-f3e3-4100-9f04-2dd59ee9309e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:03.241797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6091e-f3e3-4100-9f04-2dd59ee9309e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:03.242958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6091e-f3e3-4100-9f04-2dd59ee9309e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:03.244657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6091e-f3e3-4100-9f04-2dd59ee9309e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:03.246262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 84/178] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:03.252042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8816706-3b54-4de9-a8ef-0930054e3e4f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:03.260721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8816706-3b54-4de9-a8ef-0930054e3e4f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:03.264904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f23583-7338-47cc-a65e-354f9a78ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:03.265584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f23583-7338-47cc-a65e-354f9a78ae22 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:03.265862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f23583-7338-47cc-a65e-354f9a78ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:03.266200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f23583-7338-47cc-a65e-354f9a78ae22 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:03.267428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f23583-7338-47cc-a65e-354f9a78ae22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:03.269330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f23583-7338-47cc-a65e-354f9a78ae22 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:03.352927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 95/179] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:03 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:05.062072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae1249-7c4a-46e2-87ce-c5a6dc665be2 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.063024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae1249-7c4a-46e2-87ce-c5a6dc665be2 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.063541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae1249-7c4a-46e2-87ce-c5a6dc665be2 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.065700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 85/180] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:05.071191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512197ef-33e3-4a9e-848c-cfaf83f08159 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.071982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512197ef-33e3-4a9e-848c-cfaf83f08159 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.072448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512197ef-33e3-4a9e-848c-cfaf83f08159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.090965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-512197ef-33e3-4a9e-848c-cfaf83f08159 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:05.092437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-512197ef-33e3-4a9e-848c-cfaf83f08159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:05.100223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 96/181] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:05.123806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae1249-7c4a-46e2-87ce-c5a6dc665be2 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.136591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae1249-7c4a-46e2-87ce-c5a6dc665be2 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.141810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.142826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.143297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.143755 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.154577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:05.161805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:05.163501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 86/182] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:05.169246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512197ef-33e3-4a9e-848c-cfaf83f08159 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.179104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512197ef-33e3-4a9e-848c-cfaf83f08159 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.183748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.184643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.185115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.185595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.186542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:05.187053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.188914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.197556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 97/183] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.207267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.218094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254ff6c-c001-4a26-8f7e-68d30e1cebfe admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.223283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.224366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.224837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.225361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] PATH_INFO: `/v3/users/39f804e30e8748b7ab9e4770429a5a8a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.226760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] RBAC: Authorizing `identity:get_user(user_id=39f804e30e8748b7ab9e4770429a5a8a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.229162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.231050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 87/184] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/users/39f804e30e8748b7ab9e4770429a5a8a => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.238731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.248629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976727fa-cd6f-453c-9744-a52a89621a09 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.253307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.254159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.254654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.255132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.263259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.265215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.282492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 98/185] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:05.283824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.294590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3c032-3100-4789-901f-93c1bbc49de5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.299786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15d2a-d51d-463c-ba30-7282080a1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.300840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15d2a-d51d-463c-ba30-7282080a1dab admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.301396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15d2a-d51d-463c-ba30-7282080a1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.301861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15d2a-d51d-463c-ba30-7282080a1dab admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.303247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15d2a-d51d-463c-ba30-7282080a1dab admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.305501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15d2a-d51d-463c-ba30-7282080a1dab admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.307367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 88/186] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.315195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.324331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be980c-8486-4bcd-bd9f-c78288352d60 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.329500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de50561-c1c2-4588-92e8-9ff11ba22d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.330379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de50561-c1c2-4588-92e8-9ff11ba22d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.330872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de50561-c1c2-4588-92e8-9ff11ba22d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.331329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de50561-c1c2-4588-92e8-9ff11ba22d0b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.332360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de50561-c1c2-4588-92e8-9ff11ba22d0b admin admin] RBAC: Adding query filter params (role.id=0a193e6ac39c40ba875fedca1d23e212, scope.project.id=3e88c14381f143b8800eac20d6950613, user.id=39f804e30e8748b7ab9e4770429a5a8a) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:05.332858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de50561-c1c2-4588-92e8-9ff11ba22d0b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.334898 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de50561-c1c2-4588-92e8-9ff11ba22d0b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.341389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 99/187] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/role_assignments?user.id=39f804e30e8748b7ab9e4770429a5a8a&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=0a193e6ac39c40ba875fedca1d23e212 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.663483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaca1b-449e-4013-9c73-d06af85e9da0 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.663712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaca1b-449e-4013-9c73-d06af85e9da0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.664112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaca1b-449e-4013-9c73-d06af85e9da0 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.666046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 89/188] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:05.671084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0703c-ccf6-468c-9747-5798bafc7608 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.671373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0703c-ccf6-468c-9747-5798bafc7608 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.671649 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0703c-ccf6-468c-9747-5798bafc7608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.689450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3fe0703c-ccf6-468c-9747-5798bafc7608 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:05.690608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3fe0703c-ccf6-468c-9747-5798bafc7608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:05.698024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 100/189] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:05.721803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaca1b-449e-4013-9c73-d06af85e9da0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.733553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaca1b-449e-4013-9c73-d06af85e9da0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.738286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.739046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.739319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.739583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.749309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:05.755954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:05.757249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 90/190] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:05.762589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0703c-ccf6-468c-9747-5798bafc7608 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.771892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0703c-ccf6-468c-9747-5798bafc7608 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.776092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a74f5-aa0e-4e14-9443-ceeb76127f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.776740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a74f5-aa0e-4e14-9443-ceeb76127f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.777017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a74f5-aa0e-4e14-9443-ceeb76127f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.777299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a74f5-aa0e-4e14-9443-ceeb76127f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.778068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a74f5-aa0e-4e14-9443-ceeb76127f57 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:05.778372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a74f5-aa0e-4e14-9443-ceeb76127f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.779957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a74f5-aa0e-4e14-9443-ceeb76127f57 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.788428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 101/191] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.793590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.806214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28beca20-528f-4994-bc57-935a7f6959fe admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.810439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c447-4cbb-4bc5-945e-bc74286caf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.811281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c447-4cbb-4bc5-945e-bc74286caf8f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.811559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c447-4cbb-4bc5-945e-bc74286caf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.811834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c447-4cbb-4bc5-945e-bc74286caf8f admin admin] PATH_INFO: `/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.822700 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c075f-4957-4e27-80ab-57c2ac5c7c8c None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.823007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c075f-4957-4e27-80ab-57c2ac5c7c8c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.823284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c075f-4957-4e27-80ab-57c2ac5c7c8c None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.825052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 102/192] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:05.829663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271c447-4cbb-4bc5-945e-bc74286caf8f admin admin] RBAC: Authorizing `identity:get_user(user_id=4c4bc6ee66c64f238889c9e6c7f98e1f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.830225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966dea4-7c4c-4942-a2ef-954b9b402ffc None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.830512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966dea4-7c4c-4942-a2ef-954b9b402ffc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.830790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966dea4-7c4c-4942-a2ef-954b9b402ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.831804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271c447-4cbb-4bc5-945e-bc74286caf8f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.833482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 91/193] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.835848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565f36-7b53-4f61-a290-058c77967f81 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.836139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565f36-7b53-4f61-a290-058c77967f81 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.836421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c565f36-7b53-4f61-a290-058c77967f81 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.838122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 92/194] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:05.838828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565f36-7b53-4f61-a290-058c77967f81 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.850647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c565f36-7b53-4f61-a290-058c77967f81 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.850944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9966dea4-7c4c-4942-a2ef-954b9b402ffc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:05.852133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9966dea4-7c4c-4942-a2ef-954b9b402ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:05.854784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.855390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.855666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.855934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.860137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 103/195] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:05.861354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568675-d68e-4616-b742-5c773858adc7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.861630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568675-d68e-4616-b742-5c773858adc7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.861904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d568675-d68e-4616-b742-5c773858adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.864360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.866159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.874798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 93/196] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:05.878946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4d568675-d68e-4616-b742-5c773858adc7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:05.880103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4d568675-d68e-4616-b742-5c773858adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:05.880366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.887610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 104/197] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:05.888370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568675-d68e-4616-b742-5c773858adc7 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.889194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d1ff2-c49a-4507-afae-011626b2a4ac admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.896877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.897736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.898016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.898291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.899476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.901551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.902072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d568675-d68e-4616-b742-5c773858adc7 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.903295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 94/198] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:05.924885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.924885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.924885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.924885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.925258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.925366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:05.925447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4bfc9-265f-4d29-84f9-ad2bd5edeba8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.926453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:05.927514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.927653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 105/199] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:05.928139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.928419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.928694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.929579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=4c4bc6ee66c64f238889c9e6c7f98e1f) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:05.929886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.930153 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.931754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.937707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 95/200] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/role_assignments?user.id=4c4bc6ee66c64f238889c9e6c7f98e1f&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:05.939594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b3340-e3ec-4c6d-bf71-dd067fca4632 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.944127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.944940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.948987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.948987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.949167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.949239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.949239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.950318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 106/201] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.956735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.957439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a7d55-5d39-46c5-9303-e5debdcb27f0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.962359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.963034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.963317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.963585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.964456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:05.964770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.966454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.967904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062f2e-8977-427b-bfdb-5ad3cd51d440 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.973234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d28180-6659-41d6-9377-23a6350721ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.973948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d28180-6659-41d6-9377-23a6350721ef admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.974240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d28180-6659-41d6-9377-23a6350721ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.981926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d28180-6659-41d6-9377-23a6350721ef admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:05.981926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d28180-6659-41d6-9377-23a6350721ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:05.981926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d28180-6659-41d6-9377-23a6350721ef admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:05.982199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 96/202] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:05.983263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:05.993853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95a9a1-f9a9-437d-a8bb-68fdfaa1dda4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:05.998353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:05.999239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:05.999632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:05.999799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] PATH_INFO: `/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:06.001160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] RBAC: Authorizing `identity:get_user(user_id=4c4bc6ee66c64f238889c9e6c7f98e1f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:06.003376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:06.005254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 97/203] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:05 2022] GET /identity/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:06.010577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:06.020971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b86a5-ff78-430d-ab92-e49846dd15ec admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:06.025475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:06.026129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:06.026408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:06.026681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:06.035837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:06.037653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:06.051671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 98/204] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:06.053047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:06.062317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44604555-8e70-4ba7-b15d-b18e9d5460d7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:06.066859 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:06.067783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:06.068069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:06.068337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:06.069684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:06.071761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:06.073480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 99/205] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:06 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:06.080140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:06.090606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6fb32-c70d-4980-bf34-74b3f88c559b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:06.095583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcc9a6-3ed4-4142-ae5f-5ba9d26ffcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:06.096283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcc9a6-3ed4-4142-ae5f-5ba9d26ffcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:06.096566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcc9a6-3ed4-4142-ae5f-5ba9d26ffcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:06.096847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcc9a6-3ed4-4142-ae5f-5ba9d26ffcb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:06.097731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcc9a6-3ed4-4142-ae5f-5ba9d26ffcb4 admin admin] RBAC: Adding query filter params (role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=4c4bc6ee66c64f238889c9e6c7f98e1f) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:06.098045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcc9a6-3ed4-4142-ae5f-5ba9d26ffcb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:06.099910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcc9a6-3ed4-4142-ae5f-5ba9d26ffcb4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:06.105885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 100/206] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:06 2022] GET /identity/v3/role_assignments?user.id=4c4bc6ee66c64f238889c9e6c7f98e1f&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:06.297928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 107/207] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:05 2022] POST /identity/v3/users => generated 297 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 03:59:08.169135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3de1ab-fcc7-4715-a0ea-978f8f0d19f6 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.169720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3de1ab-fcc7-4715-a0ea-978f8f0d19f6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.169720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3de1ab-fcc7-4715-a0ea-978f8f0d19f6 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.171470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 101/208] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:08.177410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49615-7a55-4a76-a44d-45b220dc2dca None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.177821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49615-7a55-4a76-a44d-45b220dc2dca None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.178007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49615-7a55-4a76-a44d-45b220dc2dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.196390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-69d49615-7a55-4a76-a44d-45b220dc2dca None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:08.197615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-69d49615-7a55-4a76-a44d-45b220dc2dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:08.206119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 108/209] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:08.228484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3de1ab-fcc7-4715-a0ea-978f8f0d19f6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.241795 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3de1ab-fcc7-4715-a0ea-978f8f0d19f6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.246185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ac20-68fe-4839-b143-0af93e03b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.246958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ac20-68fe-4839-b143-0af93e03b82f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.247234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ac20-68fe-4839-b143-0af93e03b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.247506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ac20-68fe-4839-b143-0af93e03b82f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.258730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ac20-68fe-4839-b143-0af93e03b82f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:08.265497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-c2e1ac20-68fe-4839-b143-0af93e03b82f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:08.267390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 102/210] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:08.273014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49615-7a55-4a76-a44d-45b220dc2dca None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.282639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d937b-9ebb-43fa-bbd0-a18005b8ba6c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.282639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d937b-9ebb-43fa-bbd0-a18005b8ba6c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.282639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d937b-9ebb-43fa-bbd0-a18005b8ba6c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.286063 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 103/211] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:08.286194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49615-7a55-4a76-a44d-45b220dc2dca None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.288895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019177-b555-4cfc-a80c-61a60487583c None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.289183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019177-b555-4cfc-a80c-61a60487583c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.289507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2019177-b555-4cfc-a80c-61a60487583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.290177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.290988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.291494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.292003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.292999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:08.293471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.295307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.304634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 109/212] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:08.308715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b2019177-b555-4cfc-a80c-61a60487583c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:08.310124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.311319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b2019177-b555-4cfc-a80c-61a60487583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:08.320250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 104/213] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:08.321343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29027c65-6bdf-40c3-b270-ea6c30669456 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.329747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.330575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.330854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.331120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] PATH_INFO: `/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.332325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] RBAC: Authorizing `identity:get_user(user_id=4c4bc6ee66c64f238889c9e6c7f98e1f)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.334460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.336262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 110/214] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:08.341618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2019177-b555-4cfc-a80c-61a60487583c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.346510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.351170 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2019177-b555-4cfc-a80c-61a60487583c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.355680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.356523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.356798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.357066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.357764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b71f33-a1dc-4269-a8fc-68c307ff270d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.358295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.360891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.362856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 105/215] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:08.362970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.363818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.364178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.364545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.368544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.379538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903a6ff-1314-4e35-ad6e-1c254ef0834c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.379828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:08.385579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.386471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.386747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.387017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193/users/4c4bc6ee66c64f238889c9e6c7f98e1f/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.388475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:08.389092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce579fcab604dd693f48b9303e6a193, user_id=4c4bc6ee66c64f238889c9e6c7f98e1f, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.390177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 111/216] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:08.392398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.397019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.407670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575c0c5-e1db-4e93-818b-dfb1f4db00d4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.412271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.412981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.413263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.413552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.414310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:08.414614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.416203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.424747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 112/217] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:08.430365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.441120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d55f7-1198-4b63-b518-a246b58a44a4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.445783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.446670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.446952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.447233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] PATH_INFO: `/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.448519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c4bc6ee66c64f238889c9e6c7f98e1f)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.450724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.452648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 113/218] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:08.458557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.466562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 106/219] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:08 2022] PUT /identity/v3/projects/bce579fcab604dd693f48b9303e6a193/users/4c4bc6ee66c64f238889c9e6c7f98e1f/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:08.471984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e6e44-b55c-46f3-af23-9c71cb9a1a87 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.536137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98055ea-802f-4bc3-bfbf-b86a81287c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.537365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98055ea-802f-4bc3-bfbf-b86a81287c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.537834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98055ea-802f-4bc3-bfbf-b86a81287c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.538308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98055ea-802f-4bc3-bfbf-b86a81287c86 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.539873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98055ea-802f-4bc3-bfbf-b86a81287c86 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.542294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98055ea-802f-4bc3-bfbf-b86a81287c86 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.544453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 114/220] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:08.551053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.563958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebaa5da-22fe-49d5-ba67-d5b87345e936 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.568906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b50b8-9afd-4c5c-85eb-0db02d96754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.570028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b50b8-9afd-4c5c-85eb-0db02d96754f admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.570450 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b50b8-9afd-4c5c-85eb-0db02d96754f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.570864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b50b8-9afd-4c5c-85eb-0db02d96754f admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193/users/4c4bc6ee66c64f238889c9e6c7f98e1f/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.573407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b50b8-9afd-4c5c-85eb-0db02d96754f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce579fcab604dd693f48b9303e6a193, user_id=4c4bc6ee66c64f238889c9e6c7f98e1f, role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.576215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b50b8-9afd-4c5c-85eb-0db02d96754f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.659749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7697ba9-3386-4e8d-ba24-fb555d2a1cb3 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.660126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7697ba9-3386-4e8d-ba24-fb555d2a1cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.660414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7697ba9-3386-4e8d-ba24-fb555d2a1cb3 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.662363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 115/221] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:08.668163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0f46-467f-4802-93d4-c21d60cfa20c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.668443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0f46-467f-4802-93d4-c21d60cfa20c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.668746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0f46-467f-4802-93d4-c21d60cfa20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.685148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 107/222] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:08 2022] PUT /identity/v3/projects/bce579fcab604dd693f48b9303e6a193/users/4c4bc6ee66c64f238889c9e6c7f98e1f/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:08.694361 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f14d0f46-467f-4802-93d4-c21d60cfa20c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:08.695656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f14d0f46-467f-4802-93d4-c21d60cfa20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:08.715999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db995-6163-45db-860e-73e6aa189e3c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.716285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db995-6163-45db-860e-73e6aa189e3c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.716569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53db995-6163-45db-860e-73e6aa189e3c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.718436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 108/223] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:08.725067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534203-150a-40d7-9395-04088dbb066c None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.725372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534203-150a-40d7-9395-04088dbb066c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.725647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534203-150a-40d7-9395-04088dbb066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.746975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-72534203-150a-40d7-9395-04088dbb066c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:08.748338 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-72534203-150a-40d7-9395-04088dbb066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:08.764038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 116/224] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:08.788011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0f46-467f-4802-93d4-c21d60cfa20c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.800642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0f46-467f-4802-93d4-c21d60cfa20c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.807393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.808261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.808547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.808997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.820675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 109/225] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:08.823471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:08.831253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:08.833067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 117/226] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:08.839180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534203-150a-40d7-9395-04088dbb066c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.849479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534203-150a-40d7-9395-04088dbb066c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.850352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.854552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.855436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.855857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.856341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.857261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:08.857603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.859244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.862660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d9de-f1f9-4da1-a497-06f57dec721f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.869463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.869634 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 110/227] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:08.870677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.871119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.871393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.872637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.874540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.875023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.880589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 118/228] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:08.881882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.886261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2704932-c378-43b3-89ba-084de3f360f1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.893675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.893874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b462b6-f3ca-44ba-a0f4-4acaf3fbb007 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.894750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.895029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.895307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] PATH_INFO: `/v3/users/cf7540a004c94f37b7c58c578bc82132` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.898603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f57f-d27a-4196-b491-766947ae6fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.901705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f57f-d27a-4196-b491-766947ae6fef admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.901705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f57f-d27a-4196-b491-766947ae6fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.901705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f57f-d27a-4196-b491-766947ae6fef admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.902244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038f57f-d27a-4196-b491-766947ae6fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.904311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038f57f-d27a-4196-b491-766947ae6fef admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.913403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf7540a004c94f37b7c58c578bc82132)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.916149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.921324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 111/229] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/users/cf7540a004c94f37b7c58c578bc82132 => generated 297 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:08.924067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.934639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455875d-5b59-4f88-94fd-24b151962ab1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.941633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.941896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.942328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.942672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.950830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.952705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.962726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 112/230] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:08.967878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:08.976927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59821c1-7aba-4f01-ad66-e0934b37a283 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:08.981263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:08.982097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:08.982380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:08.982656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:08.983820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:08.986517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:08.988434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 113/231] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:08.994857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:09.005059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca6b8-d32f-4f01-9b2a-018b37125878 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:09.009334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b0fd3-a2fa-4909-827d-e38102e36030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:09.009951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0fd3-a2fa-4909-827d-e38102e36030 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:09.010233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0fd3-a2fa-4909-827d-e38102e36030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:09.010535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b0fd3-a2fa-4909-827d-e38102e36030 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:09.011335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b0fd3-a2fa-4909-827d-e38102e36030 admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=cf7540a004c94f37b7c58c578bc82132) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:09.011643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b0fd3-a2fa-4909-827d-e38102e36030 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:09.013517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b0fd3-a2fa-4909-827d-e38102e36030 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:09.019024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 114/232] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:08 2022] GET /identity/v3/role_assignments?user.id=cf7540a004c94f37b7c58c578bc82132&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=64a2c6a95efd482bb4146a547361d31c => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:09.098955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 119/233] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:08 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:10.821613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279779-0502-425e-b9d0-71650e7eabfc None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:10.822125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279779-0502-425e-b9d0-71650e7eabfc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:10.822196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279779-0502-425e-b9d0-71650e7eabfc None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:10.823899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 115/234] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:10.829409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185df0-be08-49c9-afea-7e47965438f8 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:10.829806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185df0-be08-49c9-afea-7e47965438f8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:10.829995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185df0-be08-49c9-afea-7e47965438f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:10.858543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ff185df0-be08-49c9-afea-7e47965438f8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:10.859870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ff185df0-be08-49c9-afea-7e47965438f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:10.868042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 120/235] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:10.891325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279779-0502-425e-b9d0-71650e7eabfc None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:10.907504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279779-0502-425e-b9d0-71650e7eabfc None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:10.914732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:10.915555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:10.915848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:10.916107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:10.930212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:10.936949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:10.938679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 116/236] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:10.944545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff185df0-be08-49c9-afea-7e47965438f8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:10.953801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff185df0-be08-49c9-afea-7e47965438f8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:10.961542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:10.962208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:10.962485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:10.962756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:10.963523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:10.963827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:10.965561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:10.977363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 121/237] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:10.982592 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:10.998914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876654-a251-4f07-87a8-8748d73b686b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.009349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.010205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.010479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.010748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] PATH_INFO: `/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.016365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] RBAC: Authorizing `identity:get_user(user_id=4c4bc6ee66c64f238889c9e6c7f98e1f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.018523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.020120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 117/238] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:10 2022] GET /identity/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:11.025756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.035714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564aeac-c50e-48b4-8bc8-34a4020b1167 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.048306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ef894-51f8-4275-b0e4-159a7f867726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.048954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef894-51f8-4275-b0e4-159a7f867726 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.049238 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef894-51f8-4275-b0e4-159a7f867726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.049569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ef894-51f8-4275-b0e4-159a7f867726 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.061269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ef894-51f8-4275-b0e4-159a7f867726 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.063094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ef894-51f8-4275-b0e4-159a7f867726 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.078976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 122/239] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:11.084604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.098892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdf181-dbff-4957-a6a7-bfcde953610d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.111416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0961453-4e89-4085-a3d2-bc06ccf7a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.112268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0961453-4e89-4085-a3d2-bc06ccf7a81d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.112546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0961453-4e89-4085-a3d2-bc06ccf7a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.112818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0961453-4e89-4085-a3d2-bc06ccf7a81d admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.116385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0961453-4e89-4085-a3d2-bc06ccf7a81d admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.118475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0961453-4e89-4085-a3d2-bc06ccf7a81d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.120416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 118/240] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:11.120610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc8f00-9752-43a3-b419-aa240bc3cf70 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.120880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc8f00-9752-43a3-b419-aa240bc3cf70 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.121028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc8f00-9752-43a3-b419-aa240bc3cf70 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.122892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 123/241] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:11.128285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257402-3ee3-49f5-a333-b8f38282de2d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.128572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257402-3ee3-49f5-a333-b8f38282de2d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.128726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc8f00-9752-43a3-b419-aa240bc3cf70 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.128866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257402-3ee3-49f5-a333-b8f38282de2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.150915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc8f00-9752-43a3-b419-aa240bc3cf70 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.151540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fd257402-3ee3-49f5-a333-b8f38282de2d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:11.152656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fd257402-3ee3-49f5-a333-b8f38282de2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:11.158223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.158866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.159143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.159412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.160252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=4c4bc6ee66c64f238889c9e6c7f98e1f) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:11.160560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.162402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.168080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 119/242] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:11.176583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 124/243] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/role_assignments?user.id=4c4bc6ee66c64f238889c9e6c7f98e1f&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:11.195773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257402-3ee3-49f5-a333-b8f38282de2d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.205819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257402-3ee3-49f5-a333-b8f38282de2d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.217588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.218402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.218677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.219010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.237892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:11.245056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:11.246478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 120/244] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:11.252788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.271356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ed7db-7b97-4f80-98c2-6066eb16c3b0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.295443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.296438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.296904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.297910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.298893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:11.299387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.301186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.320980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 125/245] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:11.327181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.343281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aed96e-0ba8-482e-aa6c-6a00d56c97d2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.353465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.354331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.354606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.354873 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] PATH_INFO: `/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.362289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c4bc6ee66c64f238889c9e6c7f98e1f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.364528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.366314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 121/246] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/users/4c4bc6ee66c64f238889c9e6c7f98e1f => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:11.372191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.386837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20fe37-1ab8-4c34-b6f6-5849674fac55 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.393853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.394516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.394797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.395071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.409195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.410957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.420009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 126/247] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:11.426531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.436976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb16099-f408-4368-8a6e-3ce76f4c6361 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.449669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add120f0-c954-4a4a-ab8c-80b792eea7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.450532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add120f0-c954-4a4a-ab8c-80b792eea7dc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.450865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add120f0-c954-4a4a-ab8c-80b792eea7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.451144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add120f0-c954-4a4a-ab8c-80b792eea7dc admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.452414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add120f0-c954-4a4a-ab8c-80b792eea7dc admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.454855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add120f0-c954-4a4a-ab8c-80b792eea7dc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.456589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 122/248] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:11.462907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.474371 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aed304-9ac8-4e15-99dd-3a449eb84aed admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.478878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb593d9-c3bb-4b98-a306-942884004496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.479514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb593d9-c3bb-4b98-a306-942884004496 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.479791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb593d9-c3bb-4b98-a306-942884004496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.480063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb593d9-c3bb-4b98-a306-942884004496 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.480907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb593d9-c3bb-4b98-a306-942884004496 admin admin] RBAC: Adding query filter params (role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=4c4bc6ee66c64f238889c9e6c7f98e1f) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:11.481213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb593d9-c3bb-4b98-a306-942884004496 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.483077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb593d9-c3bb-4b98-a306-942884004496 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.491622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 127/249] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/role_assignments?user.id=4c4bc6ee66c64f238889c9e6c7f98e1f&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:11.818039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d9e7e-8af7-4b98-a2a7-618becdad3f8 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.818385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d9e7e-8af7-4b98-a2a7-618becdad3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.818602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d9e7e-8af7-4b98-a2a7-618becdad3f8 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.820404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 123/250] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:11.825450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672919-ee08-4453-b309-68e14368a942 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.825742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672919-ee08-4453-b309-68e14368a942 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.826020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672919-ee08-4453-b309-68e14368a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.844132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5d672919-ee08-4453-b309-68e14368a942 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:11.845266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5d672919-ee08-4453-b309-68e14368a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:11.852589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 128/251] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:11.883995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d9e7e-8af7-4b98-a2a7-618becdad3f8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.897397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d9e7e-8af7-4b98-a2a7-618becdad3f8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.901865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.902630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.902908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.906705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.913690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:11.920589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:11.921965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 124/252] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:11.924837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49655d4-01c1-4d27-b371-cc7358f14480 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.925227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49655d4-01c1-4d27-b371-cc7358f14480 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.925774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49655d4-01c1-4d27-b371-cc7358f14480 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.929317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.929428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 129/253] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:11.932891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25b2e4-81a0-4236-b794-b7ac4923a5cc None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.933171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25b2e4-81a0-4236-b794-b7ac4923a5cc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.934030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25b2e4-81a0-4236-b794-b7ac4923a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.937212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f8c3-5c6c-4d05-afe2-e50c96187ef9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.942357 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.943003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.943285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.943562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.944324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:11.944630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.946250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.951489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-da25b2e4-81a0-4236-b794-b7ac4923a5cc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:11.952674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-da25b2e4-81a0-4236-b794-b7ac4923a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:11.955334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 125/254] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:11.960806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.961340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 130/255] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:11.971169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ad20a-d573-4de2-b6e7-b910fa953ae2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.975656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:11.976536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:11.976818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:11.977094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] PATH_INFO: `/v3/users/cf7540a004c94f37b7c58c578bc82132` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:11.978421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf7540a004c94f37b7c58c578bc82132)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:11.980607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:11.982614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 126/256] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/users/cf7540a004c94f37b7c58c578bc82132 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:11.985491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25b2e4-81a0-4236-b794-b7ac4923a5cc None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.988446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:11.995098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25b2e4-81a0-4236-b794-b7ac4923a5cc None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:11.999963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.000860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.001139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.001445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.001780 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548be40-74ce-48e4-9594-1d22724d3866 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.007092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.008152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.008622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.009081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.010480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.011979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:12.012884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.014724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 127/257] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:12.019649 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:12.020905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 131/258] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:12.021118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.026358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.031246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec309b-469d-4414-ab24-00bd6a235e2e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.035536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.035990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50028e-4a50-466b-9cc1-206b67e70321 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.036379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.036656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.036915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193/users/cf7540a004c94f37b7c58c578bc82132/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.038848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce579fcab604dd693f48b9303e6a193, user_id=cf7540a004c94f37b7c58c578bc82132, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.040524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.041204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.041440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.041588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.041833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.042584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:12.042939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.044621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.053843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 132/259] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:12.058981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.068595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a727f-0408-4ae4-8e39-48139ca37a1e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.072795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.073632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.073908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.074179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] PATH_INFO: `/v3/users/21db36bdb9474e299cea12af2cecc6a0` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.087511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] RBAC: Authorizing `identity:get_user(user_id=21db36bdb9474e299cea12af2cecc6a0)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.089675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.091272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 133/260] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:12 2022] GET /identity/v3/users/21db36bdb9474e299cea12af2cecc6a0 => generated 297 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:12.096426 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.101842 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 128/261] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:12 2022] PUT /identity/v3/projects/bce579fcab604dd693f48b9303e6a193/users/cf7540a004c94f37b7c58c578bc82132/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:12.111196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a66dc-23b5-4e7d-8e65-d5af720c4d3c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.170434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.171096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.171379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.171656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.180598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.182427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.192881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 134/262] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:12.198510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.208837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63eef2-be83-49ba-beaa-ed0d48b4d723 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.213684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b7b2d-3e93-4cd1-8f52-653813c83a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.214549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7b2d-3e93-4cd1-8f52-653813c83a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.214834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7b2d-3e93-4cd1-8f52-653813c83a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.215110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7b2d-3e93-4cd1-8f52-653813c83a25 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.216339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b7b2d-3e93-4cd1-8f52-653813c83a25 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.218456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b7b2d-3e93-4cd1-8f52-653813c83a25 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.220899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 129/263] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:12 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:12.226987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.237092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccadc7-1bae-496d-bd75-3536f7c7a0e1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.241675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d1138-864b-4540-bd58-70e98419c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.242341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1138-864b-4540-bd58-70e98419c541 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.242654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1138-864b-4540-bd58-70e98419c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.242949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d1138-864b-4540-bd58-70e98419c541 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.243752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1138-864b-4540-bd58-70e98419c541 admin admin] RBAC: Adding query filter params (role.id=0a193e6ac39c40ba875fedca1d23e212, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=21db36bdb9474e299cea12af2cecc6a0) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:12.244066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1138-864b-4540-bd58-70e98419c541 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.245974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d1138-864b-4540-bd58-70e98419c541 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.256077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 135/264] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:12 2022] GET /identity/v3/role_assignments?user.id=21db36bdb9474e299cea12af2cecc6a0&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=0a193e6ac39c40ba875fedca1d23e212 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:12.256290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfd45-2d45-4895-bd57-25db38394ff5 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.256290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfd45-2d45-4895-bd57-25db38394ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.256290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfd45-2d45-4895-bd57-25db38394ff5 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.256290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 130/265] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:12.261626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b7c0b-10ef-4556-bdb5-9f5695742223 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.261909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b7c0b-10ef-4556-bdb5-9f5695742223 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.262189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b7c0b-10ef-4556-bdb5-9f5695742223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.285184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b31b7c0b-10ef-4556-bdb5-9f5695742223 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:12.286583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b31b7c0b-10ef-4556-bdb5-9f5695742223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:12.294597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 136/266] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:12.320312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfd45-2d45-4895-bd57-25db38394ff5 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.333730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfd45-2d45-4895-bd57-25db38394ff5 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.338688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786620-343e-4f3a-af34-8ba78f1669ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.339665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786620-343e-4f3a-af34-8ba78f1669ab admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.340045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786620-343e-4f3a-af34-8ba78f1669ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.340387 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786620-343e-4f3a-af34-8ba78f1669ab admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.341809 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786620-343e-4f3a-af34-8ba78f1669ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.343738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786620-343e-4f3a-af34-8ba78f1669ab admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.345754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 131/267] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:12.351154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b7c0b-10ef-4556-bdb5-9f5695742223 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:12.360677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b7c0b-10ef-4556-bdb5-9f5695742223 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:12.365234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fdd38-6e45-4320-b764-342543ba5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:12.366072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fdd38-6e45-4320-b764-342543ba5e29 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:12.366453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fdd38-6e45-4320-b764-342543ba5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:12.366826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fdd38-6e45-4320-b764-342543ba5e29 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:12.367666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fdd38-6e45-4320-b764-342543ba5e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:12.370367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fdd38-6e45-4320-b764-342543ba5e29 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:12.456383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 137/268] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:12 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 03:59:14.329857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8de87-25d4-4286-9904-68a7b020350f None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.330375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8de87-25d4-4286-9904-68a7b020350f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.330375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8de87-25d4-4286-9904-68a7b020350f None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.332420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 132/269] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:14.337977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3171a0-321d-43ef-b0fd-ac8f015b7dea None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.338386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3171a0-321d-43ef-b0fd-ac8f015b7dea None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.338552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3171a0-321d-43ef-b0fd-ac8f015b7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.356666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2d3171a0-321d-43ef-b0fd-ac8f015b7dea None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:14.357883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2d3171a0-321d-43ef-b0fd-ac8f015b7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:14.366302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 138/270] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:14.389139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8de87-25d4-4286-9904-68a7b020350f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.403691 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8de87-25d4-4286-9904-68a7b020350f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.408212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.408987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.409267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.409565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.420033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:14.426939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:14.428417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 133/271] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:14.434020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3171a0-321d-43ef-b0fd-ac8f015b7dea None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.443763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3171a0-321d-43ef-b0fd-ac8f015b7dea None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.448341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.449004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.449301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.449593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.450362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:14.450669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.452277 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.462236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 139/272] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:14.467501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.478218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01620f7-f8bf-479b-89c6-3db38489e24e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.482618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.483448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.483727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.484001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] PATH_INFO: `/v3/users/cf7540a004c94f37b7c58c578bc82132` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.485250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf7540a004c94f37b7c58c578bc82132)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.487523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.489087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 134/273] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/users/cf7540a004c94f37b7c58c578bc82132 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:14.494427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.504795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59029e-1f39-4e75-b97f-2ce829cff521 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.509262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77872c-16fd-4382-9d20-5cb87241449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.509925 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77872c-16fd-4382-9d20-5cb87241449e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.510205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77872c-16fd-4382-9d20-5cb87241449e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.510480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77872c-16fd-4382-9d20-5cb87241449e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.520134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77872c-16fd-4382-9d20-5cb87241449e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.522045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77872c-16fd-4382-9d20-5cb87241449e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.532733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 140/274] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:14.538787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.540490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9b89d-fc1b-4106-9203-afcca1270082 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.540783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9b89d-fc1b-4106-9203-afcca1270082 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.541068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9b89d-fc1b-4106-9203-afcca1270082 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.542975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 141/275] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:14.549217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d257b0-9c2d-4b21-9394-b94e6b70cacd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.549535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d4283-769f-4b75-a7ac-9aa589110254 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.549733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d257b0-9c2d-4b21-9394-b94e6b70cacd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.549876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d257b0-9c2d-4b21-9394-b94e6b70cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.554157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.555010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.555292 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.555566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.556775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.558900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.560779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 135/276] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:14.566869 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.569299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f1d257b0-9c2d-4b21-9394-b94e6b70cacd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:14.570497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f1d257b0-9c2d-4b21-9394-b94e6b70cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:14.576556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309730c9-65d4-4433-bf91-d01b7944a6ee admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.578161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 142/277] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:14.581153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.581816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.582097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.582372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.583213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=cf7540a004c94f37b7c58c578bc82132) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:14.583522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.585718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.591717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 136/278] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/role_assignments?user.id=cf7540a004c94f37b7c58c578bc82132&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=64a2c6a95efd482bb4146a547361d31c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:14.601838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d257b0-9c2d-4b21-9394-b94e6b70cacd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.611640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d257b0-9c2d-4b21-9394-b94e6b70cacd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.616374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.617205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.617526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.617803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.630717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:14.637783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:14.639024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 143/279] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:14.645156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.659287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230965d3-d287-4f94-9606-3b41171c3709 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.664051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.664724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.665001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.665301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.666072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:14.666376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.667983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.679034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 137/280] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:14.684833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.695606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eb2fb-fb33-4774-b9b3-3f09959bc0a5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.700632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.701831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.702302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.702755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] PATH_INFO: `/v3/users/21db36bdb9474e299cea12af2cecc6a0` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.704262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] RBAC: Authorizing `identity:get_user(user_id=21db36bdb9474e299cea12af2cecc6a0)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.706676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.713501 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 144/281] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/users/21db36bdb9474e299cea12af2cecc6a0 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:14.715174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.726164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21501972-e58e-472c-95de-9237390dccbb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.731082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28b289-76a6-4ce7-adc2-c2b2c85b3575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.732260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b289-76a6-4ce7-adc2-c2b2c85b3575 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.732748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b289-76a6-4ce7-adc2-c2b2c85b3575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.733211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b289-76a6-4ce7-adc2-c2b2c85b3575 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.734800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28b289-76a6-4ce7-adc2-c2b2c85b3575 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.737094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28b289-76a6-4ce7-adc2-c2b2c85b3575 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.743850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 138/282] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:14.745522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.757189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439cac3-a6b0-41f6-aa53-e1636c8d8768 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.762119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee6f92-4361-4964-9927-4946219beb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.763267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee6f92-4361-4964-9927-4946219beb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.763731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee6f92-4361-4964-9927-4946219beb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.764208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee6f92-4361-4964-9927-4946219beb7b admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193/users/21db36bdb9474e299cea12af2cecc6a0/roles/0a193e6ac39c40ba875fedca1d23e212` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.767806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee6f92-4361-4964-9927-4946219beb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce579fcab604dd693f48b9303e6a193, user_id=21db36bdb9474e299cea12af2cecc6a0, role_id=0a193e6ac39c40ba875fedca1d23e212)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.770856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee6f92-4361-4964-9927-4946219beb7b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:14.819929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f198-044d-4a6f-86da-3d2602b4abde None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.820275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f198-044d-4a6f-86da-3d2602b4abde None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.820560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f198-044d-4a6f-86da-3d2602b4abde None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.822392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 139/283] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:14.827737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccbe9-d6fb-44ac-95e6-e2a0ca49542c None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.828023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccbe9-d6fb-44ac-95e6-e2a0ca49542c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.828837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccbe9-d6fb-44ac-95e6-e2a0ca49542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.847767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-399ccbe9-d6fb-44ac-95e6-e2a0ca49542c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:14.849011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-399ccbe9-d6fb-44ac-95e6-e2a0ca49542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:14.856401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 145/284] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:14 2022] PUT /identity/v3/projects/bce579fcab604dd693f48b9303e6a193/users/21db36bdb9474e299cea12af2cecc6a0/roles/0a193e6ac39c40ba875fedca1d23e212 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:14.857736 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531cf11-f67f-4bef-bc3c-00ca6f712374 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.858022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531cf11-f67f-4bef-bc3c-00ca6f712374 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.858298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531cf11-f67f-4bef-bc3c-00ca6f712374 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.860048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 146/285] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:14.866512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b027c-2213-4b08-b23b-dff4f1b53c0c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.866995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b027c-2213-4b08-b23b-dff4f1b53c0c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.867338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b027c-2213-4b08-b23b-dff4f1b53c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.886586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-684b027c-2213-4b08-b23b-dff4f1b53c0c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:14.887817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-684b027c-2213-4b08-b23b-dff4f1b53c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:14.913645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 140/286] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:14.938266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccbe9-d6fb-44ac-95e6-e2a0ca49542c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.947320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccbe9-d6fb-44ac-95e6-e2a0ca49542c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.952018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.952816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.953096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.953442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.956078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 147/287] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:14.965302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:14.972316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:14.973840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 141/288] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:14.979578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b027c-2213-4b08-b23b-dff4f1b53c0c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.981564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:14.991812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b027c-2213-4b08-b23b-dff4f1b53c0c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.992015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e40064-e382-4747-bd73-01773af7985a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:14.996289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.996856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:14.997106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.997419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.997688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.997975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:14.998349 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:14.998717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:14.998903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:14.999709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:15.000112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:15.001196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:15.002646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:15.003124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 142/289] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:15.008469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:15.012549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 148/290] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:15.018095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:15.019306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a24e44-4fd5-415b-a8f3-b6e7c3c0cf86 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:15.025314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d205-0c0b-4ac2-bc4a-dca156a7be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:15.025464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d205-0c0b-4ac2-bc4a-dca156a7be08 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:15.025929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d205-0c0b-4ac2-bc4a-dca156a7be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:15.026124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d205-0c0b-4ac2-bc4a-dca156a7be08 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:15.026854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d205-0c0b-4ac2-bc4a-dca156a7be08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:15.030017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a462-f25b-4cf0-8ed2-ca0d12988d2f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:15.030113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d205-0c0b-4ac2-bc4a-dca156a7be08 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:15.032690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:15.033578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:15.033867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:15.034143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] PATH_INFO: `/v3/users/36aa1da327984a7da94e1cc1dd746432` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:15.049204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=36aa1da327984a7da94e1cc1dd746432)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:15.051364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:15.053143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 149/291] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:15 2022] GET /identity/v3/users/36aa1da327984a7da94e1cc1dd746432 => generated 293 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:15.058786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:15.068665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8d9d5-d65f-425a-aea2-c647e62433d2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:15.072999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d857aaf-d8f2-492f-bd95-413790d14a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:15.073609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d857aaf-d8f2-492f-bd95-413790d14a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:15.073887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d857aaf-d8f2-492f-bd95-413790d14a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:15.074160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d857aaf-d8f2-492f-bd95-413790d14a30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:15.074985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d857aaf-d8f2-492f-bd95-413790d14a30 admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, user.id=36aa1da327984a7da94e1cc1dd746432, scope.system=all) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:15.075295 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d857aaf-d8f2-492f-bd95-413790d14a30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:15.077082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d857aaf-d8f2-492f-bd95-413790d14a30 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:15.084471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 150/292] 10.222.0.31 () {56 vars in 1329 bytes} [Sat Feb 12 03:59:15 2022] GET /identity/v3/role_assignments?user.id=36aa1da327984a7da94e1cc1dd746432&scope.system=all&role.id=64a2c6a95efd482bb4146a547361d31c => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:15.182159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 143/293] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:15 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 03:59:17.145405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76b8a-84cb-479d-85e7-742f6fc44c2a None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.145918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76b8a-84cb-479d-85e7-742f6fc44c2a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.146023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76b8a-84cb-479d-85e7-742f6fc44c2a None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.148021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 151/294] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:17.153581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1524bf-f640-47a8-9b85-6ed70642fdba None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.153993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1524bf-f640-47a8-9b85-6ed70642fdba None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.154165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1524bf-f640-47a8-9b85-6ed70642fdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.172700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fe1524bf-f640-47a8-9b85-6ed70642fdba None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:17.173935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fe1524bf-f640-47a8-9b85-6ed70642fdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:17.181675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 144/295] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:17.214058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76b8a-84cb-479d-85e7-742f6fc44c2a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.232656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76b8a-84cb-479d-85e7-742f6fc44c2a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.239496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605751d-ae1c-49a8-921f-552265212bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.240720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605751d-ae1c-49a8-921f-552265212bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.241149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605751d-ae1c-49a8-921f-552265212bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.241620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605751d-ae1c-49a8-921f-552265212bb3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.260092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605751d-ae1c-49a8-921f-552265212bb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:17.271422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-3605751d-ae1c-49a8-921f-552265212bb3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:17.273341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 152/296] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:17.282817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1524bf-f640-47a8-9b85-6ed70642fdba None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.291568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1524bf-f640-47a8-9b85-6ed70642fdba None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.296198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.297716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.298006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.298283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.298625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f138b-2074-4661-bfac-83d73ef068b6 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.298916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f138b-2074-4661-bfac-83d73ef068b6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.299067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:17.299213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f138b-2074-4661-bfac-83d73ef068b6 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.299368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.300960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 153/297] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:17.301266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.306993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e703fa-2e2c-4102-81af-da9c1c40cf34 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.307285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e703fa-2e2c-4102-81af-da9c1c40cf34 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.307567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e703fa-2e2c-4102-81af-da9c1c40cf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.313246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 145/298] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:17.320638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.331137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d1e703fa-2e2c-4102-81af-da9c1c40cf34 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:17.332902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d1e703fa-2e2c-4102-81af-da9c1c40cf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:17.335729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8370c16-5980-4ebc-8e4d-8aa8e406b2c8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.340912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.341812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.342014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 154/299] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:17.342109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.345628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] PATH_INFO: `/v3/users/21db36bdb9474e299cea12af2cecc6a0` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.347098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] RBAC: Authorizing `identity:get_user(user_id=21db36bdb9474e299cea12af2cecc6a0)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.349451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.351179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 146/300] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/users/21db36bdb9474e299cea12af2cecc6a0 => generated 297 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:17.358273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e703fa-2e2c-4102-81af-da9c1c40cf34 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.368168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e703fa-2e2c-4102-81af-da9c1c40cf34 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.368927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.372725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.373423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.373710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.373993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.380073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a051083-1c83-4aa1-b92e-2f4f310ef136 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.383185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.384994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.385804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.386766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.387247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.387696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.397427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 155/301] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:17.401540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.404395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:17.410764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7507f42-736c-4241-a33c-23a3634ed7bb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.413179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:17.414411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 147/302] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:17.415799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.416834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.417359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.417810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.419180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.420009 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.421606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.423463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 156/303] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:17.430008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.432818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e53c20-2445-4c73-8f6d-4f26510d1f61 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.438928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.439772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.440251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.440353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da55f9-2318-4e51-bf35-10934ac42283 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.440787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.441923 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:17.442405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.444412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.444920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.445661 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.446014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.446363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.447495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] RBAC: Adding query filter params (role.id=0a193e6ac39c40ba875fedca1d23e212, scope.project.id=bce579fcab604dd693f48b9303e6a193, user.id=21db36bdb9474e299cea12af2cecc6a0) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:17.448254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.450201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.455480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 148/304] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:17.459118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 157/305] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/role_assignments?user.id=21db36bdb9474e299cea12af2cecc6a0&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=0a193e6ac39c40ba875fedca1d23e212 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:17.463727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.474668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e964-d5b1-44a8-bef2-458f1b31b67f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.479712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b50a45-e7e4-4a15-ad5c-00ec453ac9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.480909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b50a45-e7e4-4a15-ad5c-00ec453ac9ed admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.481416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b50a45-e7e4-4a15-ad5c-00ec453ac9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.481894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b50a45-e7e4-4a15-ad5c-00ec453ac9ed admin admin] PATH_INFO: `/v3/users/36aa1da327984a7da94e1cc1dd746432` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.483439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b50a45-e7e4-4a15-ad5c-00ec453ac9ed admin admin] RBAC: Authorizing `identity:get_user(user_id=36aa1da327984a7da94e1cc1dd746432)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.485943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b50a45-e7e4-4a15-ad5c-00ec453ac9ed admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.487897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 149/306] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/users/36aa1da327984a7da94e1cc1dd746432 => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:17.493865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.498965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e23d6f-f0f1-45c1-95f5-143f39768734 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.499245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e23d6f-f0f1-45c1-95f5-143f39768734 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.499570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e23d6f-f0f1-45c1-95f5-143f39768734 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.502184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 150/307] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:17.506058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e14383-755b-44e0-9fe7-45775c993dfb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.508070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562a5bf-6183-44ba-b728-708ecc6742c8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.508353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562a5bf-6183-44ba-b728-708ecc6742c8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.508633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562a5bf-6183-44ba-b728-708ecc6742c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.511656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98059764-b1c2-4827-b5fc-c5a26081322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.512840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059764-b1c2-4827-b5fc-c5a26081322f admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.513445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059764-b1c2-4827-b5fc-c5a26081322f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.513902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98059764-b1c2-4827-b5fc-c5a26081322f admin admin] PATH_INFO: `/v3/system/users/36aa1da327984a7da94e1cc1dd746432/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.516564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98059764-b1c2-4827-b5fc-c5a26081322f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36aa1da327984a7da94e1cc1dd746432, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.517642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-98059764-b1c2-4827-b5fc-c5a26081322f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:17.517642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:17.517642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:17.518526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98059764-b1c2-4827-b5fc-c5a26081322f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.528280 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6562a5bf-6183-44ba-b728-708ecc6742c8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:17.529527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6562a5bf-6183-44ba-b728-708ecc6742c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:17.538241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 151/308] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:17.561614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562a5bf-6183-44ba-b728-708ecc6742c8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.572162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562a5bf-6183-44ba-b728-708ecc6742c8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.576709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e45a53-5e0a-4cfb-b5e8-bc908547da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.577545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e45a53-5e0a-4cfb-b5e8-bc908547da56 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.577815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e45a53-5e0a-4cfb-b5e8-bc908547da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.580326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e45a53-5e0a-4cfb-b5e8-bc908547da56 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.589925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e45a53-5e0a-4cfb-b5e8-bc908547da56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:17.597065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e2e45a53-5e0a-4cfb-b5e8-bc908547da56 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:17.598262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 152/309] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:17.600777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719331-e7db-4a6b-9615-97474cab4fb9 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.601064 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719331-e7db-4a6b-9615-97474cab4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.601371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719331-e7db-4a6b-9615-97474cab4fb9 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.603209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 153/310] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:17.604149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719331-e7db-4a6b-9615-97474cab4fb9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.616377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719331-e7db-4a6b-9615-97474cab4fb9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.620645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.621329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.621611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.621887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.622657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:17.622963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.624592 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.628151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 158/311] 10.222.0.31 () {58 vars in 1355 bytes} [Sat Feb 12 03:59:17 2022] PUT /identity/v3/system/users/36aa1da327984a7da94e1cc1dd746432/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:17.629932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70c94-9387-4ff2-8ea5-0225c3f6dd7e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.630425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70c94-9387-4ff2-8ea5-0225c3f6dd7e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.630916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70c94-9387-4ff2-8ea5-0225c3f6dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.634658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 154/312] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:17.640362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.651308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab895-5b17-4784-8524-3b87e20cb35e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.653261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ced70c94-9387-4ff2-8ea5-0225c3f6dd7e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:17.654517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ced70c94-9387-4ff2-8ea5-0225c3f6dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:17.656569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.657672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.658095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.658521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] PATH_INFO: `/v3/users/95f4e6d72e2c4f3dbd9713aece97b580` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.664180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 159/313] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:17.674099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] RBAC: Authorizing `identity:get_user(user_id=95f4e6d72e2c4f3dbd9713aece97b580)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.676276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.678123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 155/314] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/users/95f4e6d72e2c4f3dbd9713aece97b580 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:17.683942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced70c94-9387-4ff2-8ea5-0225c3f6dd7e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.690979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.697110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced70c94-9387-4ff2-8ea5-0225c3f6dd7e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.702963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.704259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.704545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.704822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.706691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] RBAC: Adding query filter params (role.id=0a193e6ac39c40ba875fedca1d23e212, user.id=95f4e6d72e2c4f3dbd9713aece97b580, scope.system=all) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:17.706816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704042eb-27f2-440f-8415-34b67d2e0c45 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.706894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.708337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.710956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda151d7-dc35-424e-a73b-06f8737e88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.712191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda151d7-dc35-424e-a73b-06f8737e88f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.712191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda151d7-dc35-424e-a73b-06f8737e88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.712347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda151d7-dc35-424e-a73b-06f8737e88f4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.713537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda151d7-dc35-424e-a73b-06f8737e88f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.716314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 160/315] 10.222.0.31 () {56 vars in 1329 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/role_assignments?user.id=95f4e6d72e2c4f3dbd9713aece97b580&scope.system=all&role.id=0a193e6ac39c40ba875fedca1d23e212 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:17.716451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda151d7-dc35-424e-a73b-06f8737e88f4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.717088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 156/316] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:17.723995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:17.735430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588b63c-bd62-4b50-8185-75b75a354e05 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:17.740697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4619-c13e-4b3a-a713-31ad47d8e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:17.741534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4619-c13e-4b3a-a713-31ad47d8e530 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:17.741930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4619-c13e-4b3a-a713-31ad47d8e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:17.742229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4619-c13e-4b3a-a713-31ad47d8e530 admin admin] PATH_INFO: `/v3/groups` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:17.743105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4619-c13e-4b3a-a713-31ad47d8e530 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:17.744243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-271b4619-c13e-4b3a-a713-31ad47d8e530 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:17.744243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:17.744243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:17.745719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4619-c13e-4b3a-a713-31ad47d8e530 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:17.819131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 161/317] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 03:59:17 2022] POST /identity/v3/groups => generated 229 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:19.876967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19574c-2b9a-4bc1-970f-567f62fdb218 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:19.877513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19574c-2b9a-4bc1-970f-567f62fdb218 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:19.877590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19574c-2b9a-4bc1-970f-567f62fdb218 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:19.879386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 157/318] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:19.884597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a073b0-243e-46e7-a3f1-f0b8986dafc6 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:19.885015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a073b0-243e-46e7-a3f1-f0b8986dafc6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:19.885192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a073b0-243e-46e7-a3f1-f0b8986dafc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:19.902617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a2a073b0-243e-46e7-a3f1-f0b8986dafc6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:19.903866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a2a073b0-243e-46e7-a3f1-f0b8986dafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:19.912160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 162/319] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:19.919319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fff9-57ce-47b1-b18a-a15fb047244e None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:19.919687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fff9-57ce-47b1-b18a-a15fb047244e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:19.920033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7fff9-57ce-47b1-b18a-a15fb047244e None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:19.923596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 158/320] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:19.928046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe10f-fbcd-4fd7-935f-94c1e7b50186 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:19.928344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe10f-fbcd-4fd7-935f-94c1e7b50186 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:19.928623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fe10f-fbcd-4fd7-935f-94c1e7b50186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:19.936060 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7fff9-57ce-47b1-b18a-a15fb047244e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:19.948039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7fff9-57ce-47b1-b18a-a15fb047244e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:19.948588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-515fe10f-fbcd-4fd7-935f-94c1e7b50186 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:19.950014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-515fe10f-fbcd-4fd7-935f-94c1e7b50186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:19.952617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:19.953491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:19.953700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:19.953974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:19.959062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 163/321] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:19.966981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:19.974423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:19.975761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 159/322] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:19.981574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe10f-fbcd-4fd7-935f-94c1e7b50186 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:19.982901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:19.992311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fe10f-fbcd-4fd7-935f-94c1e7b50186 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:19.993501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff2012-3532-4184-b4af-852df855c25d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:19.996853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:19.997563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:19.997843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:19.997939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:19.998110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:19.998633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:19.998887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:19.998980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:19.999324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:19.999637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.001302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.010181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 164/323] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:20.012165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:20.015470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:20.020052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:20.021747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 160/324] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:20.026899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:20.030288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e501b-622b-4734-897c-9dc11d076644 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:20.035257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:20.036105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.036383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.036655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] PATH_INFO: `/v3/users/36aa1da327984a7da94e1cc1dd746432` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.036898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29fac0-2388-43fe-9ea3-eabe9e48ce61 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:20.037901 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=36aa1da327984a7da94e1cc1dd746432)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.040008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.041469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:20.046790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 165/325] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:20 2022] GET /identity/v3/users/36aa1da327984a7da94e1cc1dd746432 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:20.046939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.046939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.046939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.046939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:20.046939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.046939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.047924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:20.054624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 161/326] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:20.059768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:20.059916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77352c0b-42fd-4bc0-a818-1d46fc1d50f9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:20.064323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c19678-cee6-4dcf-bf99-b9e8456b9094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:20.064969 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c19678-cee6-4dcf-bf99-b9e8456b9094 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.065249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c19678-cee6-4dcf-bf99-b9e8456b9094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.065552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c19678-cee6-4dcf-bf99-b9e8456b9094 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.066397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c19678-cee6-4dcf-bf99-b9e8456b9094 admin admin] RBAC: Adding query filter params (role.id=64a2c6a95efd482bb4146a547361d31c, user.id=36aa1da327984a7da94e1cc1dd746432, scope.system=all) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:20.066748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c19678-cee6-4dcf-bf99-b9e8456b9094 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.068577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c19678-cee6-4dcf-bf99-b9e8456b9094 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.069385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560875a-fdaa-45f9-bec3-af39ef5dba0f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:20.074293 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:20.075138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.075752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.076035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] PATH_INFO: `/v3/users/95f4e6d72e2c4f3dbd9713aece97b580` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.077245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] RBAC: Authorizing `identity:get_user(user_id=95f4e6d72e2c4f3dbd9713aece97b580)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.079908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.089762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 162/327] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:20 2022] GET /identity/v3/users/95f4e6d72e2c4f3dbd9713aece97b580 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:20.089944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 166/328] 10.222.0.31 () {56 vars in 1329 bytes} [Sat Feb 12 03:59:20 2022] GET /identity/v3/role_assignments?user.id=36aa1da327984a7da94e1cc1dd746432&scope.system=all&role.id=64a2c6a95efd482bb4146a547361d31c => generated 510 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:20.091086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:20.101705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed672cea-e0a6-413c-8925-0f01fe0f548d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:20.106572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:20.107457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.107736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.108013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] PATH_INFO: `/v3/system/users/95f4e6d72e2c4f3dbd9713aece97b580/roles/0a193e6ac39c40ba875fedca1d23e212` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.108815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509414-a396-410b-8224-ded7ab268646 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.109792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509414-a396-410b-8224-ded7ab268646 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.109792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509414-a396-410b-8224-ded7ab268646 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.109959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=95f4e6d72e2c4f3dbd9713aece97b580, role_id=0a193e6ac39c40ba875fedca1d23e212)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.110826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:20.110826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:20.110826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:20.111596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 167/329] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:20.111708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.117539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038c13-5418-4aa9-b98a-e44cc2fd9f6f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.117810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038c13-5418-4aa9-b98a-e44cc2fd9f6f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.118069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038c13-5418-4aa9-b98a-e44cc2fd9f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.136482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-dc038c13-5418-4aa9-b98a-e44cc2fd9f6f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:20.137640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dc038c13-5418-4aa9-b98a-e44cc2fd9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:20.146191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 168/330] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:20.169458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038c13-5418-4aa9-b98a-e44cc2fd9f6f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:20.178913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038c13-5418-4aa9-b98a-e44cc2fd9f6f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:20.183435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d73fc4-16a5-4f2f-9ccc-dc14840fe20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:20.184146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 163/331] 10.222.0.31 () {58 vars in 1355 bytes} [Sat Feb 12 03:59:20 2022] PUT /identity/v3/system/users/95f4e6d72e2c4f3dbd9713aece97b580/roles/0a193e6ac39c40ba875fedca1d23e212 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:20.189387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d73fc4-16a5-4f2f-9ccc-dc14840fe20b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.189387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d73fc4-16a5-4f2f-9ccc-dc14840fe20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.189387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d73fc4-16a5-4f2f-9ccc-dc14840fe20b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.201837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d73fc4-16a5-4f2f-9ccc-dc14840fe20b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.201837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d73fc4-16a5-4f2f-9ccc-dc14840fe20b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.201837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 169/332] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:20.202099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:20.211427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc437e75-4236-4337-a78d-c3b7c1eaa3f5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:20.216167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718c821-a2e0-40c7-ad5d-cb85284d9ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:20.216850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718c821-a2e0-40c7-ad5d-cb85284d9ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:20.217131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718c821-a2e0-40c7-ad5d-cb85284d9ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:20.217447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718c821-a2e0-40c7-ad5d-cb85284d9ed1 admin admin] PATH_INFO: `/v3/groups` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:20.218181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718c821-a2e0-40c7-ad5d-cb85284d9ed1 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:20.219802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-2718c821-a2e0-40c7-ad5d-cb85284d9ed1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:20.219802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:20.219802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:20.221008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718c821-a2e0-40c7-ad5d-cb85284d9ed1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:20.301792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 164/333] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 03:59:20 2022] POST /identity/v3/groups => generated 226 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 03:59:22.533892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d158b-b16f-45e1-83e1-06e0e0afbbce None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:22.534366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d158b-b16f-45e1-83e1-06e0e0afbbce None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:22.534366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d158b-b16f-45e1-83e1-06e0e0afbbce None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:22.536113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 170/334] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:22.542506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22aec-f7e8-4f21-84e2-051426c1b5a0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:22.542937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22aec-f7e8-4f21-84e2-051426c1b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:22.543113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c22aec-f7e8-4f21-84e2-051426c1b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:22.570277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e8c22aec-f7e8-4f21-84e2-051426c1b5a0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:22.571471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e8c22aec-f7e8-4f21-84e2-051426c1b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:22.579801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 165/335] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:22.631228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d158b-b16f-45e1-83e1-06e0e0afbbce None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:22.650674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d158b-b16f-45e1-83e1-06e0e0afbbce None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:22.657852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:22.658647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:22.658926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:22.659196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:22.678445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:22.690901 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 03:59:22.692595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 171/336] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:22.698428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c22aec-f7e8-4f21-84e2-051426c1b5a0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:22.711310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c22aec-f7e8-4f21-84e2-051426c1b5a0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:22.726674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:22.727356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:22.727634 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:22.727902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:22.728668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:22.728967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:22.730579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:22.748748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 166/337] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:22.755068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:22.770321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733c3a2-c7f3-4d5c-b291-20b47a0414c5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:22.775658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa06f89-06af-44bb-898d-e1d55c164d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:22.776515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa06f89-06af-44bb-898d-e1d55c164d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:22.776795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa06f89-06af-44bb-898d-e1d55c164d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:22.777068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa06f89-06af-44bb-898d-e1d55c164d7e admin admin] PATH_INFO: `/v3/users/95f4e6d72e2c4f3dbd9713aece97b580` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:22.782416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa06f89-06af-44bb-898d-e1d55c164d7e admin admin] RBAC: Authorizing `identity:get_user(user_id=95f4e6d72e2c4f3dbd9713aece97b580)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:22.784606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa06f89-06af-44bb-898d-e1d55c164d7e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:22.786550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 172/338] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 03:59:22 2022] GET /identity/v3/users/95f4e6d72e2c4f3dbd9713aece97b580 => generated 293 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:22.792155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:22.806208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4cede-8ed3-4ada-99ab-9164c1198b8f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:22.813313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e53c-3b62-453f-a88b-40886d7b77ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:22.813966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e53c-3b62-453f-a88b-40886d7b77ee admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:22.814240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e53c-3b62-453f-a88b-40886d7b77ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:22.814507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e53c-3b62-453f-a88b-40886d7b77ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:22.815344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e53c-3b62-453f-a88b-40886d7b77ee admin admin] RBAC: Adding query filter params (role.id=0a193e6ac39c40ba875fedca1d23e212, user.id=95f4e6d72e2c4f3dbd9713aece97b580, scope.system=all) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:22.815651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e53c-3b62-453f-a88b-40886d7b77ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:22.817507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e53c-3b62-453f-a88b-40886d7b77ee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:22.847552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 167/339] 10.222.0.31 () {56 vars in 1329 bytes} [Sat Feb 12 03:59:22 2022] GET /identity/v3/role_assignments?user.id=95f4e6d72e2c4f3dbd9713aece97b580&scope.system=all&role.id=0a193e6ac39c40ba875fedca1d23e212 => generated 510 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:23.041091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5aaa3-bac1-46e9-a0af-eb204d1e9a5d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.041461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5aaa3-bac1-46e9-a0af-eb204d1e9a5d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.041636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5aaa3-bac1-46e9-a0af-eb204d1e9a5d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.043345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 173/340] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:23.049902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d977f-0b77-4678-be55-42615425bda3 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.050211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d977f-0b77-4678-be55-42615425bda3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.050449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d977f-0b77-4678-be55-42615425bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.073663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e64d977f-0b77-4678-be55-42615425bda3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:23.074870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e64d977f-0b77-4678-be55-42615425bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:23.086032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0886f-3235-4b61-9789-7a9c29d82081 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.086327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 168/341] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:23.086481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0886f-3235-4b61-9789-7a9c29d82081 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.086624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0886f-3235-4b61-9789-7a9c29d82081 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.088557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 174/342] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:23.094254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18e12-c26b-4992-9c01-97afb04a8c40 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.094539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18e12-c26b-4992-9c01-97afb04a8c40 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.094815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e18e12-c26b-4992-9c01-97afb04a8c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.117575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e9e18e12-c26b-4992-9c01-97afb04a8c40 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:23.118777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e9e18e12-c26b-4992-9c01-97afb04a8c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:23.132931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 169/343] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:23.148954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0886f-3235-4b61-9789-7a9c29d82081 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.160089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e18e12-c26b-4992-9c01-97afb04a8c40 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.168860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0886f-3235-4b61-9789-7a9c29d82081 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.170057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e18e12-c26b-4992-9c01-97afb04a8c40 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.176558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.177139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.177368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.177622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.177887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.178052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.178209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.178485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.197542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:23.204843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:23.207188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:23.213364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 170/344] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:23.214248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.216124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:23.217480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 175/345] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:23.230380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe8449-169d-4290-8170-d4eada2091ba admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.232233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.243785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6a28-9e71-4ff3-aa50-bfaf964c2e87 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.246422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.247088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.247362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.247629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.248392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:23.248688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.250401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.256185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.256850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.257126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.257424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.258189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:23.258489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.260086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.273811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 171/346] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:23.289307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.291701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 176/347] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:23.298196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.301513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1cfb7-e42b-4a38-a380-5915770ba554 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.306290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.307083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.307524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.307948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.311359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdd650-6f93-43e9-a4c5-5ca687940fc4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.316874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.318957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.319655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.320373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.320731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.321079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.329775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 172/348] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:23.333157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.335219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.335327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.348260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245f461-f1e1-4d54-9430-2234ad2a27bd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.353389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.354142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 177/349] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:23.354959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.355429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.355891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.362100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.364415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.366824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 173/350] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:23.368473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.372031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.383674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4162a-03fd-4bf9-8aa4-64e452004c46 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.386047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5aa569-1730-492c-b357-58c3852522f5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.392839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.395453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.395809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.396719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.397262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.397887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.398947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.400092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.406947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.408625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.408725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:23.408725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:23.408725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:23.409180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.410285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.412392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 174/352] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:23.412495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 178/352] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:23.422854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.423006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.433829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeea20-9a56-4cb3-8176-a6a58b01565d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.439691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16783-9e72-4aa1-b9ee-7bea91d63110 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.443626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbd6c7-a25b-4d83-908e-a634bd5a3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.445804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd6c7-a25b-4d83-908e-a634bd5a3b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.446485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd6c7-a25b-4d83-908e-a634bd5a3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.447243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbd6c7-a25b-4d83-908e-a634bd5a3b1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.448779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd6c7-a25b-4d83-908e-a634bd5a3b1b admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=3e88c14381f143b8800eac20d6950613) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:23.450648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.451067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd6c7-a25b-4d83-908e-a634bd5a3b1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.453467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.454488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.455715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.456577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbd6c7-a25b-4d83-908e-a634bd5a3b1b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.458327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.462810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:23.462810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:23.462810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:23.465303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.469443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 179/353] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:23.469882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 175/354] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=64a2c6a95efd482bb4146a547361d31c => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:23.476812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:23.490066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2456bf-8df3-49b0-ab5d-e8c11fa59aee admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:23.497061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5ea3f-70de-4ada-807f-c1e76fba763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:23.498089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5ea3f-70de-4ada-807f-c1e76fba763b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.498543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5ea3f-70de-4ada-807f-c1e76fba763b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.498984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5ea3f-70de-4ada-807f-c1e76fba763b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.500627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5ea3f-70de-4ada-807f-c1e76fba763b admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=3e88c14381f143b8800eac20d6950613) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:23.501162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5ea3f-70de-4ada-807f-c1e76fba763b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:23.503288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5ea3f-70de-4ada-807f-c1e76fba763b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:23.510291 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 180/355] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:23 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:23.985570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c42e5-3ab5-431b-a26d-cf3c905e36c0 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.986380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c42e5-3ab5-431b-a26d-cf3c905e36c0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.986380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c42e5-3ab5-431b-a26d-cf3c905e36c0 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:23.987865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 176/356] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:23.994298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88198-d76b-489b-827d-b372cd580bdf None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:23.994751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88198-d76b-489b-827d-b372cd580bdf None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:23.994850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88198-d76b-489b-827d-b372cd580bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.017187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f3a88198-d76b-489b-827d-b372cd580bdf None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:24.018408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f3a88198-d76b-489b-827d-b372cd580bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:24.031511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 181/357] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:24.062117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c42e5-3ab5-431b-a26d-cf3c905e36c0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.079255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c42e5-3ab5-431b-a26d-cf3c905e36c0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.087436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.088223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.088508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.088787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.101564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:24.108393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:24.110334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 177/358] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:24.115905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88198-d76b-489b-827d-b372cd580bdf None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.125255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88198-d76b-489b-827d-b372cd580bdf None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.130119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff719-519f-4218-956b-594988425f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.130797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff719-519f-4218-956b-594988425f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.131081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff719-519f-4218-956b-594988425f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.131359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff719-519f-4218-956b-594988425f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.132128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ff719-519f-4218-956b-594988425f44 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:24.132435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ff719-519f-4218-956b-594988425f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:24.134058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ff719-519f-4218-956b-594988425f44 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:24.143895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 182/359] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:24.149363 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.159660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cf78b-5e4c-42e2-af5e-01e85c944110 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.164119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.164747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.165045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.165331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.176311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:24.178129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:24.187321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 178/360] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:24.193303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff719-519f-4218-956b-594988425f44 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.203228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff719-519f-4218-956b-594988425f44 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.207694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.208543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.208827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.209100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.210337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:24.212640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:24.214321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 183/361] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:24.220341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.229430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3de4de-fddd-444c-a7b4-2da804527ec6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.234091 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34aeb2-b775-499c-8e3b-c3ef512fd8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.235040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34aeb2-b775-499c-8e3b-c3ef512fd8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.235412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34aeb2-b775-499c-8e3b-c3ef512fd8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.235737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34aeb2-b775-499c-8e3b-c3ef512fd8f0 admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.236940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34aeb2-b775-499c-8e3b-c3ef512fd8f0 admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:24.238938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34aeb2-b775-499c-8e3b-c3ef512fd8f0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:24.240580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 179/362] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:24.246304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.258717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183cee-c3ba-4a70-9df7-aefa008613dc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.266935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bf5b7-d97d-4173-bd78-f0888c833ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.267644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bf5b7-d97d-4173-bd78-f0888c833ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.267930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bf5b7-d97d-4173-bd78-f0888c833ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.268208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bf5b7-d97d-4173-bd78-f0888c833ef2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.269111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bf5b7-d97d-4173-bd78-f0888c833ef2 admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=bce579fcab604dd693f48b9303e6a193) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:24.269454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bf5b7-d97d-4173-bd78-f0888c833ef2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:24.271402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bf5b7-d97d-4173-bd78-f0888c833ef2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:24.284672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 184/363] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=64a2c6a95efd482bb4146a547361d31c => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:24.720980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32fa3e-a3c8-4e8c-8ff6-619d2e1cff97 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.721366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32fa3e-a3c8-4e8c-8ff6-619d2e1cff97 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.721560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32fa3e-a3c8-4e8c-8ff6-619d2e1cff97 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.723472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 180/364] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:24.729103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b48d9f-f321-45a6-b4a7-e5553cc9c01b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.729658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b48d9f-f321-45a6-b4a7-e5553cc9c01b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.730146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b48d9f-f321-45a6-b4a7-e5553cc9c01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.750185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-67b48d9f-f321-45a6-b4a7-e5553cc9c01b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:24.751702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-67b48d9f-f321-45a6-b4a7-e5553cc9c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:24.769559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 185/365] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:24.796453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32fa3e-a3c8-4e8c-8ff6-619d2e1cff97 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.814233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32fa3e-a3c8-4e8c-8ff6-619d2e1cff97 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.821915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df357f59-e3cc-4b7c-bda4-c3278dd23f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.822777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357f59-e3cc-4b7c-bda4-c3278dd23f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.823057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357f59-e3cc-4b7c-bda4-c3278dd23f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.823328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df357f59-e3cc-4b7c-bda4-c3278dd23f69 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.836965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df357f59-e3cc-4b7c-bda4-c3278dd23f69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:24.844584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-df357f59-e3cc-4b7c-bda4-c3278dd23f69 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:24.846109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 181/366] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:24.846748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550cea-17ff-4463-8ba8-c804adaea8b1 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.847038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550cea-17ff-4463-8ba8-c804adaea8b1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.848576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550cea-17ff-4463-8ba8-c804adaea8b1 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.849204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 186/367] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:24.854444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b5bbc-2b03-4d93-bd68-3bc33a1f75c9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.854603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550cea-17ff-4463-8ba8-c804adaea8b1 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.855132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b5bbc-2b03-4d93-bd68-3bc33a1f75c9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.855740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b5bbc-2b03-4d93-bd68-3bc33a1f75c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.882503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550cea-17ff-4463-8ba8-c804adaea8b1 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.883996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-982b5bbc-2b03-4d93-bd68-3bc33a1f75c9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:24.885184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-982b5bbc-2b03-4d93-bd68-3bc33a1f75c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:24.891575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.892242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.892519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.892797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.893591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:24.893897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:24.895885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:24.908023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 182/368] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:24.910240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 187/369] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:24.922997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b5bbc-2b03-4d93-bd68-3bc33a1f75c9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.937195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:24.940781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b5bbc-2b03-4d93-bd68-3bc33a1f75c9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.952209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5889-555b-4553-9f55-47216fdf6fb1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:24.958556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.959219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.959500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.959777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.970807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:24.971657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:24.971884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:24.972215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:24.976000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:24.977799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:24.996349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 183/370] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:24.997065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:25.006331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:25.007540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 188/371] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:25.008471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.016791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.025455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c37d9-fd59-48ab-87a3-c52d89ac98f4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.036140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cecc3f-0cf2-42d1-9f98-0e32b44d58f9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.037324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.038176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.038453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.038723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.040188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.042258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.043898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 184/372] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:25.050101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.056460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.057140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.057434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.057706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.058473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:25.058775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.060356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.075487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9ca47-aec1-456b-b425-cc144252f6b5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.077385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 189/373] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:25.082670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.094497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.095361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.095645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.095918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.098475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.099088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.099300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383572-1c60-432c-9dc5-a3d47784a7d7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.101031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 185/374] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:25.104582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.105595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.106080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.106551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.110176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.116063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.118228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.131690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb4138-69e1-4b42-9dac-5867c81fd959 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.132075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 190/375] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:25.138421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.142054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.143011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.143981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.145013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.147224 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=bce579fcab604dd693f48b9303e6a193) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:25.148834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.150975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.153792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4aef9b-b8ef-4567-8933-ca51345323d3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.162946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 186/376] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:25.164805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.166024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.166513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.167032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] PATH_INFO: `/v3/projects/ea391da9e944423da861a63f18f0eef9` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.168609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ea391da9e944423da861a63f18f0eef9)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.170868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.173315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 191/377] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/projects/ea391da9e944423da861a63f18f0eef9 => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:25.182439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.193744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69693196-964e-408c-b500-fd0015b33c5b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.198759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d304bc7-9590-458f-9eb0-86e0cd504965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.199966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304bc7-9590-458f-9eb0-86e0cd504965 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.200493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304bc7-9590-458f-9eb0-86e0cd504965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.201041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304bc7-9590-458f-9eb0-86e0cd504965 admin admin] PATH_INFO: `/v3/groups/cf5cd31855e6474f97586fcff57951fa` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.207415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d304bc7-9590-458f-9eb0-86e0cd504965 admin admin] RBAC: Authorizing `identity:get_group(group_id=cf5cd31855e6474f97586fcff57951fa)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.209735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d304bc7-9590-458f-9eb0-86e0cd504965 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.211988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 187/378] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/groups/cf5cd31855e6474f97586fcff57951fa => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:25.219811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:25.230628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29e60b-70b4-422e-b04c-b151c77114a2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:25.236043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed0116-9d19-4bac-b1e3-304b11e00b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:25.237097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0116-9d19-4bac-b1e3-304b11e00b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:25.237642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0116-9d19-4bac-b1e3-304b11e00b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:25.238192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0116-9d19-4bac-b1e3-304b11e00b6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:25.239333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0116-9d19-4bac-b1e3-304b11e00b6d admin admin] RBAC: Adding query filter params (group.id=cf5cd31855e6474f97586fcff57951fa, role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=ea391da9e944423da861a63f18f0eef9) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:25.239896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0116-9d19-4bac-b1e3-304b11e00b6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:25.242110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0116-9d19-4bac-b1e3-304b11e00b6d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:25.249075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 192/379] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:25 2022] GET /identity/v3/role_assignments?group.id=cf5cd31855e6474f97586fcff57951fa&scope.project.id=ea391da9e944423da861a63f18f0eef9&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:26.142211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be69cd-739b-49e4-8c89-890d164d41ef None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.143214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be69cd-739b-49e4-8c89-890d164d41ef None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.143698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be69cd-739b-49e4-8c89-890d164d41ef None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.145964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 188/380] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:26.151655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f599b8-8a0c-4657-bcee-6c3f014cceb6 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.152498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f599b8-8a0c-4657-bcee-6c3f014cceb6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.152976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f599b8-8a0c-4657-bcee-6c3f014cceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.178436 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f1f599b8-8a0c-4657-bcee-6c3f014cceb6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:26.180022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f1f599b8-8a0c-4657-bcee-6c3f014cceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:26.194883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 193/381] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:26.235210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be69cd-739b-49e4-8c89-890d164d41ef None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.250003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be69cd-739b-49e4-8c89-890d164d41ef None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.258845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.259922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.260424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.260898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.275883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:26.283759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:26.289357 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 189/382] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:26.291605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f599b8-8a0c-4657-bcee-6c3f014cceb6 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.306298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f599b8-8a0c-4657-bcee-6c3f014cceb6 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.316500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.317449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.317952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.318424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.319384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:26.319885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.321697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.337354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 194/383] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:26.343101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.359100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236f98-c96d-4f00-becd-c5e05978802c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.368331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.369508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.370023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.370493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.372100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.374322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.376841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 190/384] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:26.382638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.393129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154b3b-9b51-4f6c-a8d9-464c1808db5a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.401404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9bcbd-7c68-4fbb-bdf9-df3803e2c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.402503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bcbd-7c68-4fbb-bdf9-df3803e2c97b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.402984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bcbd-7c68-4fbb-bdf9-df3803e2c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.403479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bcbd-7c68-4fbb-bdf9-df3803e2c97b admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.404905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9bcbd-7c68-4fbb-bdf9-df3803e2c97b admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.407718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9bcbd-7c68-4fbb-bdf9-df3803e2c97b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.409999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 195/385] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:26.415305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.425972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb7e68-c1f9-437d-b49d-890cc637d7af admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.430858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.431945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.432425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.432896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.438715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88c14381f143b8800eac20d6950613, group_id=3658314b75ea4f209a83bfab1bf50f2d, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.441617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.461893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f784b-d062-4477-947c-d00043da6d72 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.462486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f784b-d062-4477-947c-d00043da6d72 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.462929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f784b-d062-4477-947c-d00043da6d72 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.470694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 196/386] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:26.470694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787bcda-7170-4527-a479-01516d66b133 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.470694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787bcda-7170-4527-a479-01516d66b133 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.471053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787bcda-7170-4527-a479-01516d66b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.497515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2787bcda-7170-4527-a479-01516d66b133 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:26.498755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2787bcda-7170-4527-a479-01516d66b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:26.512073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 197/387] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:26.538414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787bcda-7170-4527-a479-01516d66b133 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.538646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 191/388] 10.222.0.31 () {58 vars in 1463 bytes} [Sat Feb 12 03:59:26 2022] PUT /identity/v3/projects/3e88c14381f143b8800eac20d6950613/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:26.550350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787bcda-7170-4527-a479-01516d66b133 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.622819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.623894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.624313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.624722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.640936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:26.648624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:26.650109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 198/389] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:26.656731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.675596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b91a7-7c18-43d1-96e9-28498df96a2a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.684770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.685499 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.685784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.686061 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.686844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:26.687153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.689370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.700943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 192/390] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:26.706478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.723225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ddc90-c0d0-49c5-8060-1cdf00e6300a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.730102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.731220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.731642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.732056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.734747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.737005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.738884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 199/391] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:26.744656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.758572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0603785-b3b5-4ab6-a8a3-4e1074a836be admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.768711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e79c59-fb58-449c-824f-694cae165c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.769628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e79c59-fb58-449c-824f-694cae165c8a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.769913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e79c59-fb58-449c-824f-694cae165c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.770190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e79c59-fb58-449c-824f-694cae165c8a admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.774177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e79c59-fb58-449c-824f-694cae165c8a admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.776297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e79c59-fb58-449c-824f-694cae165c8a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.778432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 193/392] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:26 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:26.783995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:26.797625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b1b66-ecb5-4775-85db-a3f89ea2c5f7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:26.803312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c4b14-e182-44c2-bc73-65e59da8aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:26.804422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c4b14-e182-44c2-bc73-65e59da8aac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:26.804925 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c4b14-e182-44c2-bc73-65e59da8aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:26.805422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c4b14-e182-44c2-bc73-65e59da8aac5 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:26.807936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c4b14-e182-44c2-bc73-65e59da8aac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88c14381f143b8800eac20d6950613, group_id=3658314b75ea4f209a83bfab1bf50f2d, role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:26.810826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c4b14-e182-44c2-bc73-65e59da8aac5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:26.887988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 200/393] 10.222.0.31 () {58 vars in 1463 bytes} [Sat Feb 12 03:59:26 2022] PUT /identity/v3/projects/3e88c14381f143b8800eac20d6950613/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:27.533625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770da56-a964-4608-a620-1b784ff78e76 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:27.534150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770da56-a964-4608-a620-1b784ff78e76 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:27.534373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770da56-a964-4608-a620-1b784ff78e76 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:27.536369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 194/394] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:27.541311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2826335-22fb-4c40-8b49-a06b93ad0f6a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:27.541740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2826335-22fb-4c40-8b49-a06b93ad0f6a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:27.541912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2826335-22fb-4c40-8b49-a06b93ad0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:27.566403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a2826335-22fb-4c40-8b49-a06b93ad0f6a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:27.567630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a2826335-22fb-4c40-8b49-a06b93ad0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:27.627658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 201/395] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:27.668774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770da56-a964-4608-a620-1b784ff78e76 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:27.681773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770da56-a964-4608-a620-1b784ff78e76 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:27.689549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:27.690341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:27.690624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:27.690901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:27.706861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:27.713948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:27.717373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 195/396] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:27.720819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2826335-22fb-4c40-8b49-a06b93ad0f6a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:27.735070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2826335-22fb-4c40-8b49-a06b93ad0f6a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:27.741483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:27.742152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:27.742432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:27.742705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:27.743469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:27.743776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:27.745422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:27.756826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 202/397] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:27.762724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:27.776748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab7d8f-930b-4afc-9ee7-77bde4e4f02f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:27.782909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:27.784141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:27.784629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:27.785165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:27.786673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:27.788843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:27.791144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 196/398] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:27 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:27.796496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:27.811110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a64e8b-01ca-4542-b690-356e456c5879 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:27.824208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afde4c-dd50-4f16-86fb-462953e33d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:27.825084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afde4c-dd50-4f16-86fb-462953e33d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:27.825394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afde4c-dd50-4f16-86fb-462953e33d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:27.825672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afde4c-dd50-4f16-86fb-462953e33d8f admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:27.830037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afde4c-dd50-4f16-86fb-462953e33d8f admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:27.832084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afde4c-dd50-4f16-86fb-462953e33d8f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:27.834182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 203/399] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:27 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:27.839678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:27.850484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be34bc-dc8d-42bd-8fb2-29ba408cd38d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:27.858442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1ebbb-db6e-41d8-88f9-720c847062ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:27.860118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ebbb-db6e-41d8-88f9-720c847062ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:27.860610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ebbb-db6e-41d8-88f9-720c847062ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:27.861116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ebbb-db6e-41d8-88f9-720c847062ae admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:27.864640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1ebbb-db6e-41d8-88f9-720c847062ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce579fcab604dd693f48b9303e6a193, group_id=3658314b75ea4f209a83bfab1bf50f2d, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:27.867324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1ebbb-db6e-41d8-88f9-720c847062ae admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:27.989832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 197/400] 10.222.0.31 () {58 vars in 1463 bytes} [Sat Feb 12 03:59:27 2022] PUT /identity/v3/projects/bce579fcab604dd693f48b9303e6a193/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:28.103784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e1649-0f22-41ce-8ea2-d21edb8a7e91 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.104131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e1649-0f22-41ce-8ea2-d21edb8a7e91 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.104344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e1649-0f22-41ce-8ea2-d21edb8a7e91 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.106203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 204/401] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:28.112306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd82a7-8aa3-45f2-8451-fe0ea273d429 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.112594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd82a7-8aa3-45f2-8451-fe0ea273d429 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.112871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd82a7-8aa3-45f2-8451-fe0ea273d429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.138537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e1cd82a7-8aa3-45f2-8451-fe0ea273d429 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:28.139760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e1cd82a7-8aa3-45f2-8451-fe0ea273d429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:28.206813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 198/402] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:28.226855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c636-59fd-4bdb-8c6b-b455955f7fc2 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.227173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c636-59fd-4bdb-8c6b-b455955f7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.227416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235c636-59fd-4bdb-8c6b-b455955f7fc2 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.229178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 205/403] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:28.236613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851ed62-bcef-4a1f-89bf-7c396dd68591 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.236906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851ed62-bcef-4a1f-89bf-7c396dd68591 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.237187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851ed62-bcef-4a1f-89bf-7c396dd68591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.240218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235c636-59fd-4bdb-8c6b-b455955f7fc2 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.255328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235c636-59fd-4bdb-8c6b-b455955f7fc2 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.258304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-4851ed62-bcef-4a1f-89bf-7c396dd68591 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:28.260453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4851ed62-bcef-4a1f-89bf-7c396dd68591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:28.261772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.262814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.263294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.263764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.269517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 199/404] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:28.282558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:28.290313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:28.292010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 206/405] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:28.296550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851ed62-bcef-4a1f-89bf-7c396dd68591 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.298236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.305556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851ed62-bcef-4a1f-89bf-7c396dd68591 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.309218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e587e6-1c7d-4fd3-aca4-ed551b1ceb37 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.311203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.312143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.312490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.312771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.315050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.316065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.316517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.316997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.318093 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:28.318576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.320540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.326250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:28.331211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 207/406] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:28.334297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:28.336036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 200/407] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:28.341694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.343010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.360347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9411425-1f69-4857-b251-39783f8af1dd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.363266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fa633-8163-4baf-82af-4614c9e06457 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.371047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.371718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.372005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.372285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.373055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:28.373386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.375053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.377123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.378007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.378284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.378551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.379800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.381745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.383350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 201/408] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:28.390258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 208/409] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:28.391204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.402430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.413398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86059-678c-4098-a532-2491b505a89c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.421352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c5027-08f9-40cc-999e-d464f41ec975 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.425411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.426439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.426883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.427379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.429321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.431970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.434127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 202/410] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:28.435488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.436500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.436939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.437457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] PATH_INFO: `/v3/groups/cf5cd31855e6474f97586fcff57951fa` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.439673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.440072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] RBAC: Authorizing `identity:get_group(group_id=cf5cd31855e6474f97586fcff57951fa)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.442157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.449096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 209/411] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/groups/cf5cd31855e6474f97586fcff57951fa => generated 229 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:28.458580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47e660-a4c8-4a25-b3e5-cfcd56ba0611 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.463570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe5779-0d00-4ec5-a5f4-b07a9077f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.464634 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5779-0d00-4ec5-a5f4-b07a9077f2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.465052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5779-0d00-4ec5-a5f4-b07a9077f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.465505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe5779-0d00-4ec5-a5f4-b07a9077f2f2 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.469004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.475586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe5779-0d00-4ec5-a5f4-b07a9077f2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce579fcab604dd693f48b9303e6a193, group_id=3658314b75ea4f209a83bfab1bf50f2d, role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.479468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe5779-0d00-4ec5-a5f4-b07a9077f2f2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.481914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e43cb-ac5d-4a79-8456-ec353949d595 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.490801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.491827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.492260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.492693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] PATH_INFO: `/v3/projects/ea391da9e944423da861a63f18f0eef9` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.494739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] RBAC: Authorizing `identity:get_project(project_id=ea391da9e944423da861a63f18f0eef9)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.496796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.499805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 210/412] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:28 2022] GET /identity/v3/projects/ea391da9e944423da861a63f18f0eef9 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:28.505442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:28.516170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35921768-9b61-4d45-a47c-8c4a88272835 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:28.522919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e506-3a7d-4062-a36d-3ed9127e3685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:28.523910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e506-3a7d-4062-a36d-3ed9127e3685 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:28.524346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e506-3a7d-4062-a36d-3ed9127e3685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:28.524722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e506-3a7d-4062-a36d-3ed9127e3685 admin admin] PATH_INFO: `/v3/projects/ea391da9e944423da861a63f18f0eef9/groups/cf5cd31855e6474f97586fcff57951fa/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:28.526874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e506-3a7d-4062-a36d-3ed9127e3685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea391da9e944423da861a63f18f0eef9, group_id=cf5cd31855e6474f97586fcff57951fa, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:28.529691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e506-3a7d-4062-a36d-3ed9127e3685 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:28.570107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 203/413] 10.222.0.31 () {58 vars in 1463 bytes} [Sat Feb 12 03:59:28 2022] PUT /identity/v3/projects/bce579fcab604dd693f48b9303e6a193/groups/3658314b75ea4f209a83bfab1bf50f2d/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:28.602405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 211/414] 10.222.0.31 () {58 vars in 1463 bytes} [Sat Feb 12 03:59:28 2022] PUT /identity/v3/projects/ea391da9e944423da861a63f18f0eef9/groups/cf5cd31855e6474f97586fcff57951fa/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:29.601680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3c63-e99e-4164-ae3d-5c91bfa124de None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.602701 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3c63-e99e-4164-ae3d-5c91bfa124de None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.603220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3c63-e99e-4164-ae3d-5c91bfa124de None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.605444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 204/415] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:29.610525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fdeb8-499d-46fa-a9a5-1e72ff613b74 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.611357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fdeb8-499d-46fa-a9a5-1e72ff613b74 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.611845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fdeb8-499d-46fa-a9a5-1e72ff613b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.633514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6b7fdeb8-499d-46fa-a9a5-1e72ff613b74 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:29.635040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6b7fdeb8-499d-46fa-a9a5-1e72ff613b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:29.705829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 212/416] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:29.732673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3c63-e99e-4164-ae3d-5c91bfa124de None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:29.754150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3c63-e99e-4164-ae3d-5c91bfa124de None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:29.763686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:29.764464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.764739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.765008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.782686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:29.789486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:29.790856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 205/417] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:29.796493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fdeb8-499d-46fa-a9a5-1e72ff613b74 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:29.806422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fdeb8-499d-46fa-a9a5-1e72ff613b74 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:29.821010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:29.821707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.821989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.822309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.823031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:29.823338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:29.824996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:29.845491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 213/418] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:29.846754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:29.862374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b946d2-608c-4223-89f9-6c6a09fa55b2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:29.868136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:29.868829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.869120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.869432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.879936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:29.881792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:29.891938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 206/419] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:29.897804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:29.915546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bf61c-03fa-45c1-8c91-3104a223243e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:29.922592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:29.923823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.924313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.924790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.926503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:29.928856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:29.931345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 214/420] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:29 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:29.937155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:29.951269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3d15-f2ef-4972-a897-f1713c0d0976 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:29.957950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ee91a-d089-4d6e-9413-8d66f4a3b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:29.958829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee91a-d089-4d6e-9413-8d66f4a3b5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.959113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee91a-d089-4d6e-9413-8d66f4a3b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.959390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee91a-d089-4d6e-9413-8d66f4a3b5a8 admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.961005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ee91a-d089-4d6e-9413-8d66f4a3b5a8 admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:29.962910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ee91a-d089-4d6e-9413-8d66f4a3b5a8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:29.969508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 207/421] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:29 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:29.970770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:29.986943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb12fa-70bf-4027-ba13-ba8a13b8d5b1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:29.994233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574092a-4be6-47d2-98a4-8b40050dfa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:29.995169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574092a-4be6-47d2-98a4-8b40050dfa81 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:29.995683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574092a-4be6-47d2-98a4-8b40050dfa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:29.996241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574092a-4be6-47d2-98a4-8b40050dfa81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:29.997336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574092a-4be6-47d2-98a4-8b40050dfa81 admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=3e88c14381f143b8800eac20d6950613) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:29.997855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574092a-4be6-47d2-98a4-8b40050dfa81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:30.000063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574092a-4be6-47d2-98a4-8b40050dfa81 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:30.009409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 215/422] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:29 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=64a2c6a95efd482bb4146a547361d31c => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:30.239447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bf8ad-b7c7-4e9c-b0e1-b23c76043f0f None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.239778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bf8ad-b7c7-4e9c-b0e1-b23c76043f0f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.239966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bf8ad-b7c7-4e9c-b0e1-b23c76043f0f None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.241696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 208/423] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:30.247761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d6866-67f5-4020-9112-aa5644f5d171 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.248394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d6866-67f5-4020-9112-aa5644f5d171 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.248870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d6866-67f5-4020-9112-aa5644f5d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.274320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b12d6866-67f5-4020-9112-aa5644f5d171 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:30.275518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b12d6866-67f5-4020-9112-aa5644f5d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:30.288857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 216/424] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:30.315583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bf8ad-b7c7-4e9c-b0e1-b23c76043f0f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:30.335324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bf8ad-b7c7-4e9c-b0e1-b23c76043f0f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:30.341372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:30.342180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.342453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.342780 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.358727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:30.366093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:30.367602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 209/425] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:30.373240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d6866-67f5-4020-9112-aa5644f5d171 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:30.383360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d6866-67f5-4020-9112-aa5644f5d171 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:30.390312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:30.391315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.391857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.392336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.395076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:30.395603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:30.397508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:30.407246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 217/426] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:30.413029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:30.426281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d136-0682-40a3-9cc6-8f7f1467c5bd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:30.433477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:30.434110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.434389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.434723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.445472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:30.447325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:30.461030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 210/427] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:30.466544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:30.481199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba6bd1-9e0e-43a8-8bb8-bfb3eb42d12b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:30.486346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:30.487883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.488360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.488824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] PATH_INFO: `/v3/projects/3e88c14381f143b8800eac20d6950613` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.490373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e88c14381f143b8800eac20d6950613)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:30.492650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:30.494993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 218/428] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:30 2022] GET /identity/v3/projects/3e88c14381f143b8800eac20d6950613 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:30.501041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:30.509868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c7d08-840c-4d75-ac1e-980a4b31e770 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:30.515739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e7110-f4d9-4a5b-a22b-855370def715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:30.516563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e7110-f4d9-4a5b-a22b-855370def715 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.516836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e7110-f4d9-4a5b-a22b-855370def715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.517105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e7110-f4d9-4a5b-a22b-855370def715 admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.518309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e7110-f4d9-4a5b-a22b-855370def715 admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:30.520171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e7110-f4d9-4a5b-a22b-855370def715 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:30.521753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 211/429] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:30 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:30.527612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:30.537442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197be03-8877-4673-85be-fd267135e893 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:30.541809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de396d-895c-445b-b47b-26c7c3774c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:30.542434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de396d-895c-445b-b47b-26c7c3774c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.542715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de396d-895c-445b-b47b-26c7c3774c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.542986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de396d-895c-445b-b47b-26c7c3774c13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.543820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de396d-895c-445b-b47b-26c7c3774c13 admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=3e88c14381f143b8800eac20d6950613) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:30.544125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de396d-895c-445b-b47b-26c7c3774c13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:30.545978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de396d-895c-445b-b47b-26c7c3774c13 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:30.555245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 219/430] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:30 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=3e88c14381f143b8800eac20d6950613&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:30.941750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f1ad-2712-43d9-819c-8f240fb071f6 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.942739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f1ad-2712-43d9-819c-8f240fb071f6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.943241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1f1ad-2712-43d9-819c-8f240fb071f6 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.945179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 212/431] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:30.950723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee9cb0-442d-4721-a801-37f6b0b699df None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:30.951550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee9cb0-442d-4721-a801-37f6b0b699df None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:30.951985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee9cb0-442d-4721-a801-37f6b0b699df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:30.971215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ddee9cb0-442d-4721-a801-37f6b0b699df None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:30.972739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ddee9cb0-442d-4721-a801-37f6b0b699df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:30.980648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 220/432] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:31.004720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1f1ad-2712-43d9-819c-8f240fb071f6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.017542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1f1ad-2712-43d9-819c-8f240fb071f6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.022155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.023188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.023667 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.024129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.035799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:31.043029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 03:59:31.044476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 213/433] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:31.050309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee9cb0-442d-4721-a801-37f6b0b699df None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.060298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee9cb0-442d-4721-a801-37f6b0b699df None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.065596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.066526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.067012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.067476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.068450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:31.068961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.070793 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.079778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 221/434] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:31.086018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.097410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e92244-4dda-4f57-8fb9-1b38a1889a02 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.102190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.103117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.103591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.104126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.113738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.115778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.126452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 214/435] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:31.131848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.142792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfbf02-52df-42aa-b35f-ca70a926f152 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.148283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.149167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.149562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.149840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.151177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.153297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.155463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 222/436] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:31.161184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.171025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b9fac-165c-4eec-b934-c75ab77a4e58 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.175934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a9807-f9d0-488c-88fd-54bcab1b348b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.176979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a9807-f9d0-488c-88fd-54bcab1b348b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.177477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a9807-f9d0-488c-88fd-54bcab1b348b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.177908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a9807-f9d0-488c-88fd-54bcab1b348b admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.179349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a9807-f9d0-488c-88fd-54bcab1b348b admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.181447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a9807-f9d0-488c-88fd-54bcab1b348b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.183536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 215/437] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:31.190407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.200808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091cfc7-1a02-4f26-80b1-c3df31ddc952 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.206693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f99d37-40f3-479d-9003-f8b5811293c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.207850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99d37-40f3-479d-9003-f8b5811293c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.208355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99d37-40f3-479d-9003-f8b5811293c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.208862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99d37-40f3-479d-9003-f8b5811293c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.210099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f99d37-40f3-479d-9003-f8b5811293c5 admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=64a2c6a95efd482bb4146a547361d31c, scope.project.id=bce579fcab604dd693f48b9303e6a193) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:31.210895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f99d37-40f3-479d-9003-f8b5811293c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.213163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f99d37-40f3-479d-9003-f8b5811293c5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.220863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 223/438] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=64a2c6a95efd482bb4146a547361d31c => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:31.441174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f77ae-d25f-4dd6-ae7f-01074c6ff35f None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.441693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f77ae-d25f-4dd6-ae7f-01074c6ff35f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.441973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f77ae-d25f-4dd6-ae7f-01074c6ff35f None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.443974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 216/439] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:31.450120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db69357-b13a-43e6-bced-616ca3039ea7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.450720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db69357-b13a-43e6-bced-616ca3039ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.451052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db69357-b13a-43e6-bced-616ca3039ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.470606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0db69357-b13a-43e6-bced-616ca3039ea7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:31.471788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0db69357-b13a-43e6-bced-616ca3039ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:31.479549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 224/440] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:31.503576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f77ae-d25f-4dd6-ae7f-01074c6ff35f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.514169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc324ef-25ac-4184-ac7f-5af35bd5be13 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.514479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc324ef-25ac-4184-ac7f-5af35bd5be13 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.514732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc324ef-25ac-4184-ac7f-5af35bd5be13 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.516917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f77ae-d25f-4dd6-ae7f-01074c6ff35f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.517691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 225/441] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:31.521642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.522415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.522580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b872330-e40a-4792-a549-afc38f412c67 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.522702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.522918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b872330-e40a-4792-a549-afc38f412c67 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.523024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.523194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b872330-e40a-4792-a549-afc38f412c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.534042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:31.540961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:31.542178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 217/442] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:31.545585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0b872330-e40a-4792-a549-afc38f412c67 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:31.546889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0b872330-e40a-4792-a549-afc38f412c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:31.548062 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.556236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 226/443] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:31.562495 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e53327-f1bb-478b-aa3f-8dad34a676a1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.567100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.567764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.568049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.568325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.569595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:31.569595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.571003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.581978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 218/444] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:31.584384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b872330-e40a-4792-a549-afc38f412c67 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.587779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.594705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b872330-e40a-4792-a549-afc38f412c67 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.597656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c394-a9f1-43e6-b143-1be1f185971f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.599258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.600061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.600334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.600586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.603145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.604102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.604544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.604963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.612230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:31.616459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.618246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.619381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:31.620853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 227/445] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:31.626412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.627689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 219/446] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:31.633826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.637387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1818ab-0030-45b4-84fb-1a2d7a732e3a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.641551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.642362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.642641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.642912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.643667 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:31.643785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae804d1c-520e-48d0-8926-ae7b75afb98c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.643980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.645570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.648314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.649594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.649874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.650149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] PATH_INFO: `/v3/projects/ea391da9e944423da861a63f18f0eef9` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.651348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] RBAC: Authorizing `identity:get_project(project_id=ea391da9e944423da861a63f18f0eef9)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.653120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.654819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 220/447] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/projects/ea391da9e944423da861a63f18f0eef9 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:31.656741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 228/448] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:31.660732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.662726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.670285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733f9d3-0050-4605-bc89-a235563e0982 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.672660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca8204-318e-4051-8805-a952c86c3ffc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.674882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.675789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.676074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.676344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] PATH_INFO: `/v3/groups/cf5cd31855e6474f97586fcff57951fa` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.678408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.678533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] RBAC: Authorizing `identity:get_group(group_id=cf5cd31855e6474f97586fcff57951fa)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.679045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.679327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.679600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.680423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.685309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 221/449] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/groups/cf5cd31855e6474f97586fcff57951fa => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:31.688408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.689248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.691100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.697902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c44e-b2b4-4611-a72f-4a545081cdb2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.700124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 229/450] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:31.702230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.702794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.703646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.703919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.704746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] RBAC: Adding query filter params (group.id=cf5cd31855e6474f97586fcff57951fa, role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=ea391da9e944423da861a63f18f0eef9) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:31.705058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.706889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.706988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.713057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 222/451] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/role_assignments?group.id=cf5cd31855e6474f97586fcff57951fa&scope.project.id=ea391da9e944423da861a63f18f0eef9&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:31.716581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b359f5-6943-4ef1-adf6-cb47ff8fce3e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.721121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.722036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.722324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.722601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] PATH_INFO: `/v3/projects/bce579fcab604dd693f48b9303e6a193` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.723860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=bce579fcab604dd693f48b9303e6a193)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.725982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.727746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 230/452] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/projects/bce579fcab604dd693f48b9303e6a193 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:31.733643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.743659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae914f74-dd89-463c-b942-89b63d848094 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.748127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3b0c1-06fb-4620-ac9b-bde307e0516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.748986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3b0c1-06fb-4620-ac9b-bde307e0516e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.749264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3b0c1-06fb-4620-ac9b-bde307e0516e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.749574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3b0c1-06fb-4620-ac9b-bde307e0516e admin admin] PATH_INFO: `/v3/groups/3658314b75ea4f209a83bfab1bf50f2d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.751367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3b0c1-06fb-4620-ac9b-bde307e0516e admin admin] RBAC: Authorizing `identity:get_group(group_id=3658314b75ea4f209a83bfab1bf50f2d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.753303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3b0c1-06fb-4620-ac9b-bde307e0516e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.754912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 223/453] 10.222.0.31 () {56 vars in 1201 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/groups/3658314b75ea4f209a83bfab1bf50f2d => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:31.760952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:31.771728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e47f-8d4f-49f8-9fa5-b5168c9833d2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:31.776724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54858e3-3c4d-42fb-9375-f8f9288f96a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:31.777439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54858e3-3c4d-42fb-9375-f8f9288f96a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:31.777726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54858e3-3c4d-42fb-9375-f8f9288f96a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:31.778004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54858e3-3c4d-42fb-9375-f8f9288f96a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:31.778857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54858e3-3c4d-42fb-9375-f8f9288f96a3 admin admin] RBAC: Adding query filter params (group.id=3658314b75ea4f209a83bfab1bf50f2d, role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=bce579fcab604dd693f48b9303e6a193) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:31.779170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54858e3-3c4d-42fb-9375-f8f9288f96a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:31.781062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54858e3-3c4d-42fb-9375-f8f9288f96a3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:31.787619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 231/454] 10.222.0.31 () {56 vars in 1397 bytes} [Sat Feb 12 03:59:31 2022] GET /identity/v3/role_assignments?group.id=3658314b75ea4f209a83bfab1bf50f2d&scope.project.id=bce579fcab604dd693f48b9303e6a193&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:34.681078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052763b8-0d7b-439e-bbb8-d186e4f17387 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.682137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052763b8-0d7b-439e-bbb8-d186e4f17387 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.682646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052763b8-0d7b-439e-bbb8-d186e4f17387 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.684614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 224/455] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:34.690680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8546-b7f7-4d5b-a4ab-028a1e452fc3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.691668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8546-b7f7-4d5b-a4ab-028a1e452fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.692159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae8546-b7f7-4d5b-a4ab-028a1e452fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.713414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9eae8546-b7f7-4d5b-a4ab-028a1e452fc3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:34.714915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9eae8546-b7f7-4d5b-a4ab-028a1e452fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:34.723452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 232/456] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:34.742143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7931-8b6a-4d0c-932d-ea24cdfb3fae None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.742720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7931-8b6a-4d0c-932d-ea24cdfb3fae None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.743229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7931-8b6a-4d0c-932d-ea24cdfb3fae None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.745171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 225/457] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:34.750773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb2da-e46c-456f-ac24-bcf4a2057a2d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.751278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb2da-e46c-456f-ac24-bcf4a2057a2d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.751754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb2da-e46c-456f-ac24-bcf4a2057a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.768915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c7931-8b6a-4d0c-932d-ea24cdfb3fae None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:34.786264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c7931-8b6a-4d0c-932d-ea24cdfb3fae None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:34.790090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0cfbb2da-e46c-456f-ac24-bcf4a2057a2d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:34.792780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0cfbb2da-e46c-456f-ac24-bcf4a2057a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:34.793925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:34.794965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.796544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.797105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.811797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 233/458] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:34.822497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:34.824682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:34.837025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb2da-e46c-456f-ac24-bcf4a2057a2d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:34.848068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb2da-e46c-456f-ac24-bcf4a2057a2d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:34.858768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:34.862721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:34.863854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.864363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.864859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.873521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 226/459] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:34.881790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:34.888059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:34.889929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:34.901875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163142-e73d-446a-8e58-b22585f5de8c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:34.913811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:34.914997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 234/460] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:34.922560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:34.923219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.923500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.923772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.924514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:34.924819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:34.925863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:34.925863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:34.925863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:34.926197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:34.926724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:34.950944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b98f2-52af-4e5e-bd90-734d47cb3499 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:34.955208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 227/461] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:34.958531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:34.959184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.959460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.959731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.960472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:34.961027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:34.962884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:34.964467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:34.980788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f5dc4-b6c7-4b83-975c-0919a094d28a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:34.987299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 235/462] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:34.990016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1573-5730-45d2-9bc8-442c71b3de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:34.990668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1573-5730-45d2-9bc8-442c71b3de8b admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:34.990943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1573-5730-45d2-9bc8-442c71b3de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:34.991209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1573-5730-45d2-9bc8-442c71b3de8b admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:34.992599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:34.993438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1573-5730-45d2-9bc8-442c71b3de8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:34.995344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1573-5730-45d2-9bc8-442c71b3de8b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.011689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd2b67-2201-424b-870b-19c12eddfe56 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:35.016469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9825af-2d27-4d4c-b377-dd58c5f22bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:35.017121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9825af-2d27-4d4c-b377-dd58c5f22bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.017475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9825af-2d27-4d4c-b377-dd58c5f22bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.017747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9825af-2d27-4d4c-b377-dd58c5f22bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.018523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9825af-2d27-4d4c-b377-dd58c5f22bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:35.020549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9825af-2d27-4d4c-b377-dd58c5f22bc3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.120231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 228/463] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:34 2022] POST /identity/v3/users => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 03:59:35.126601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6a12-54a2-47ca-bed3-7d74040be514 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.126871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6a12-54a2-47ca-bed3-7d74040be514 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.127153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6a12-54a2-47ca-bed3-7d74040be514 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.129003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 229/464] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:35.135908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 236/465] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:34 2022] POST /identity/v3/users => generated 248 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:35.136227 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709348cd-53f4-44d2-9d60-0444ef69b957 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.136482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709348cd-53f4-44d2-9d60-0444ef69b957 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.136856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709348cd-53f4-44d2-9d60-0444ef69b957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.137454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8bed-7427-4f65-942d-10b6cae68704 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.137745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8bed-7427-4f65-942d-10b6cae68704 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.138023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d8bed-7427-4f65-942d-10b6cae68704 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.140140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 237/466] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:35.146742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad4c37-478e-4343-9bf2-6db5b7de54dd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.147210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad4c37-478e-4343-9bf2-6db5b7de54dd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.147587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad4c37-478e-4343-9bf2-6db5b7de54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.170668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-709348cd-53f4-44d2-9d60-0444ef69b957 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:35.171398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-56ad4c37-478e-4343-9bf2-6db5b7de54dd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:35.172456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-709348cd-53f4-44d2-9d60-0444ef69b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:35.173314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-56ad4c37-478e-4343-9bf2-6db5b7de54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:35.183021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 230/467] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:35.184887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 238/468] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:35.231274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709348cd-53f4-44d2-9d60-0444ef69b957 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:35.235701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad4c37-478e-4343-9bf2-6db5b7de54dd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:35.242694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709348cd-53f4-44d2-9d60-0444ef69b957 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:35.246752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad4c37-478e-4343-9bf2-6db5b7de54dd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:35.254944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:35.255974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:35.257038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.258251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.258828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.259327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.259796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.260263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.275281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:35.277319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:35.277758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.285200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.310158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:35.311748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 231/469] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:35.318202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:35.326468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:35.329222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 239/470] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:35.333814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df88f6-97d2-4806-a8e8-3bce50f61143 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:35.335456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:35.342059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:35.343014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.343510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.343978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.344810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:35.345186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:35.346922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.347261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bae5bb-5aac-400f-b5b0-d0519ad6dcf5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:35.352145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:35.353091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.353645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.354110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.355059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:35.355551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:35.357378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.364573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 232/471] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:35.370846 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:35.371216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 240/472] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:35.376954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:35.382995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925712-f573-4eec-bf39-75e206029127 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:35.389466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad5091-8d8f-48ea-9d38-381579983cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:35.391585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5091-8d8f-48ea-9d38-381579983cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.392087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5091-8d8f-48ea-9d38-381579983cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.392569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5091-8d8f-48ea-9d38-381579983cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.393321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad5091-8d8f-48ea-9d38-381579983cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:35.394506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390658b4-04ec-4814-914d-b65a1f0ca42f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:35.395604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad5091-8d8f-48ea-9d38-381579983cf0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.400842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf2e4b-ec41-45ee-8965-a96607b75952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:35.401556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf2e4b-ec41-45ee-8965-a96607b75952 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:35.401839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf2e4b-ec41-45ee-8965-a96607b75952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:35.402114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf2e4b-ec41-45ee-8965-a96607b75952 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:35.402821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf2e4b-ec41-45ee-8965-a96607b75952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:35.404929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf2e4b-ec41-45ee-8965-a96607b75952 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:35.504085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 233/473] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:35 2022] POST /identity/v3/users => generated 248 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:35.536784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 241/474] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:35 2022] POST /identity/v3/users => generated 249 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 03:59:36.131335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1885c-c62d-4017-97a2-144fac9005c7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:36.131844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1885c-c62d-4017-97a2-144fac9005c7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:36.131919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1885c-c62d-4017-97a2-144fac9005c7 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:36.133824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 234/475] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:36.150084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252773e0-dc61-4a2c-a551-a27198bde37c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:36.150595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252773e0-dc61-4a2c-a551-a27198bde37c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:36.150679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252773e0-dc61-4a2c-a551-a27198bde37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:36.175739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-252773e0-dc61-4a2c-a551-a27198bde37c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:36.176934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-252773e0-dc61-4a2c-a551-a27198bde37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:36.185176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 242/476] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:36.231083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1885c-c62d-4017-97a2-144fac9005c7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:36.247024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1885c-c62d-4017-97a2-144fac9005c7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:36.251537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:36.252190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:36.252470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:36.252745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:36.253539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:36.255206 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:36.295313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.sql.core [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 12 03:59:36.295313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 12 03:59:36.295313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [parameters: {'id': '6c8c9ee82b1347b09dd42457f0da371f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 12 03:59:36.295313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79509) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 12 03:59:36.315127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 12 03:59:36.316614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 235/477] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 03:59:36 2022] POST /identity/v3/roles => generated 144 bytes in 86 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:36.322401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252773e0-dc61-4a2c-a551-a27198bde37c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:36.334260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252773e0-dc61-4a2c-a551-a27198bde37c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:36.345415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b552f-9d1b-4db1-beeb-ea6193ce532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:36.346445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b552f-9d1b-4db1-beeb-ea6193ce532a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:36.346954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b552f-9d1b-4db1-beeb-ea6193ce532a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:36.347441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b552f-9d1b-4db1-beeb-ea6193ce532a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:36.366080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b552f-9d1b-4db1-beeb-ea6193ce532a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:36.373605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-a25b552f-9d1b-4db1-beeb-ea6193ce532a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 03:59:36.375821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 243/478] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 03:59:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:36.381085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:36.392251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33238-2321-475f-96b6-3aa81727b357 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:36.402565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7c78e-b5e5-4840-8820-1820f67f8dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:36.403279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7c78e-b5e5-4840-8820-1820f67f8dea admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:36.403560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7c78e-b5e5-4840-8820-1820f67f8dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:36.403836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7c78e-b5e5-4840-8820-1820f67f8dea admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:36.404658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7c78e-b5e5-4840-8820-1820f67f8dea admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:36.404963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7c78e-b5e5-4840-8820-1820f67f8dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:36.406775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7c78e-b5e5-4840-8820-1820f67f8dea admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:36.423282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 236/479] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:37.916738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c00251-e377-46e4-8567-568427e82228 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:37.919056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c00251-e377-46e4-8567-568427e82228 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:37.919056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c00251-e377-46e4-8567-568427e82228 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:37.919386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 244/480] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:37.924922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2be098-2d1f-419a-b57a-3ae3632d75ac None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:37.925760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2be098-2d1f-419a-b57a-3ae3632d75ac None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:37.926240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2be098-2d1f-419a-b57a-3ae3632d75ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:37.958734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fd2be098-2d1f-419a-b57a-3ae3632d75ac None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:37.960391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fd2be098-2d1f-419a-b57a-3ae3632d75ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:37.976426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 237/481] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:38.000137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c00251-e377-46e4-8567-568427e82228 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.006207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6d50-ea44-4d3f-8ddd-af4f2a7c4fe0 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.006904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6d50-ea44-4d3f-8ddd-af4f2a7c4fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.007382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6d50-ea44-4d3f-8ddd-af4f2a7c4fe0 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.010146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 238/482] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:38.019310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c00251-e377-46e4-8567-568427e82228 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.019734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404e46-2b76-4047-beb7-33ea2d1d5b32 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.020229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404e46-2b76-4047-beb7-33ea2d1d5b32 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.020692 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404e46-2b76-4047-beb7-33ea2d1d5b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.023944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.024802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.025161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.025536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.048654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:38.055583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:38.061845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-3d404e46-2b76-4047-beb7-33ea2d1d5b32 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:38.063152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3d404e46-2b76-4047-beb7-33ea2d1d5b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:38.065160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 245/483] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.067894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.080175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 239/484] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:38.087750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58697e26-79a1-4c9a-b0bf-97d06414d263 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.092354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.093007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.093347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.093655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.094423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.094731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.096320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.108843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 246/485] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.117065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404e46-2b76-4047-beb7-33ea2d1d5b32 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.130947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404e46-2b76-4047-beb7-33ea2d1d5b32 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.140039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.141398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.141681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.141956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.151826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.165953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad1d56-bd45-400d-b090-91c3d3eb0405 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.173158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.174973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.176892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.177717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.178005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.178283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.204222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:38.206297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:38.217658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:38.218916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 247/486] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:38.219688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.220283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 240/487] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.230213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.241966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308a35-25b1-4466-afed-45dda4be2c22 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.244551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f385-0043-46cd-be29-a5d6f6536dda admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.251517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc925d8-3a9b-48cc-8d83-5d0d93346bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.252169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc925d8-3a9b-48cc-8d83-5d0d93346bcc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.252457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc925d8-3a9b-48cc-8d83-5d0d93346bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.252736 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc925d8-3a9b-48cc-8d83-5d0d93346bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.253497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc925d8-3a9b-48cc-8d83-5d0d93346bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.253811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc925d8-3a9b-48cc-8d83-5d0d93346bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.255391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc925d8-3a9b-48cc-8d83-5d0d93346bcc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.256521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.257165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.257471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.257741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.258499 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.258829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.260383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.271552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 241/488] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:38.278093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.293161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 248/489] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.297014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9461c-b3c9-43e6-8067-3a5525ceae13 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.298584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b67f4-c2f7-4114-9656-cb79b902e9b3 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.299201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b67f4-c2f7-4114-9656-cb79b902e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.299770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b67f4-c2f7-4114-9656-cb79b902e9b3 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.301820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88a5b7-f158-4047-ac42-a3cd839fad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.302303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 249/490] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:38.302737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a5b7-f158-4047-ac42-a3cd839fad68 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.303094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a5b7-f158-4047-ac42-a3cd839fad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.303444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a5b7-f158-4047-ac42-a3cd839fad68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.303766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b67f4-c2f7-4114-9656-cb79b902e9b3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.319857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88a5b7-f158-4047-ac42-a3cd839fad68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.321897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88a5b7-f158-4047-ac42-a3cd839fad68 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.322404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b67f4-c2f7-4114-9656-cb79b902e9b3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.327481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.328479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.329468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.329938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.338756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.340926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.341031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-6f88a5b7-f158-4047-ac42-a3cd839fad68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:38.342384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 242/491] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.345830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7f27-b7b1-496d-b7a4-c162f6b3d97a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.346318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7f27-b7b1-496d-b7a4-c162f6b3d97a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.346740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7f27-b7b1-496d-b7a4-c162f6b3d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.362409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 03:59:38.364087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 250/492] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.365474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.370553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-4f5b7f27-b7b1-496d-b7a4-c162f6b3d97a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:38.372710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4f5b7f27-b7b1-496d-b7a4-c162f6b3d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:38.376023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae231-73df-4ff6-8ed8-df389468afd8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.380562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.381451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.381923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.382365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.382659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 243/493] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:38.389325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.389472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b7f27-b7b1-496d-b7a4-c162f6b3d97a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.389885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.392078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.395388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b7f27-b7b1-496d-b7a4-c162f6b3d97a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.400431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.401195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.401575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.401959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.402932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.403323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.404406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:38.404406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:38.404406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:38.406477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e2396-9ddf-46af-a69d-aa3444e34292 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.423566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 251/494] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.424203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.438160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78872c-b767-4008-81b5-eebbf6ecddec admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.443500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.444256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.444588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.444861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.450493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 244/495] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.453319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bceea5-b2f3-4217-b3b9-c83d85ef4fb0 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.453319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bceea5-b2f3-4217-b3b9-c83d85ef4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.453319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bceea5-b2f3-4217-b3b9-c83d85ef4fb0 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.454096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 245/496] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:38.454797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bceea5-b2f3-4217-b3b9-c83d85ef4fb0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.457866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:38.465309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:38.466620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 252/497] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.467502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.471505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bceea5-b2f3-4217-b3b9-c83d85ef4fb0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.476117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1258105-2e31-4384-97d5-2b89dd64f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.476872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1258105-2e31-4384-97d5-2b89dd64f77d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.477155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1258105-2e31-4384-97d5-2b89dd64f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.477461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1258105-2e31-4384-97d5-2b89dd64f77d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.477782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40048c-9dcb-4f51-a2ff-7ab3b1a6e290 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.482759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.483350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.483629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.483907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.485598 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1258105-2e31-4384-97d5-2b89dd64f77d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.487631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1258105-2e31-4384-97d5-2b89dd64f77d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.492646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.494392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.501762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e1258105-2e31-4384-97d5-2b89dd64f77d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 03:59:38.509587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 246/498] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.509734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 253/499] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:38.509734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.509867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c819bc-6b9f-40be-933e-80de66f71101 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.509867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c819bc-6b9f-40be-933e-80de66f71101 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.509867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c819bc-6b9f-40be-933e-80de66f71101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.517867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d4863-7f07-4081-95b5-a83256c8c583 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.523099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.523727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.523826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-29c819bc-6b9f-40be-933e-80de66f71101 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:38.524026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.524278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.525010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-29c819bc-6b9f-40be-933e-80de66f71101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:38.525112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.525339 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.526891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.537466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 247/500] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:38.537466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c819bc-6b9f-40be-933e-80de66f71101 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.539839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 254/501] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.540728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.547478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c819bc-6b9f-40be-933e-80de66f71101 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.551700 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52f3ac-24cf-4622-9b45-b73a0e65d4fa admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.556444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.557122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.557261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.557461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.557852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.558578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.558763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.559168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.559405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.559902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.560345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:38.560345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:38.560345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:38.561561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.570948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.572792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.591355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:38.592537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 248/502] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.593322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.600312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 255/503] 10.222.0.31 () {56 vars in 1158 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.601130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.606487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57af88-6716-496f-b1f2-ad03d8914bac admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.610488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e846c-8335-4de0-b368-9d3b63f8d337 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.611039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.611791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.612072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.612346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.614795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.615556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.615829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.616098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.622615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.624462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.626535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:38.633452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:38.634611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 256/504] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.635364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.641477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:38.642643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 249/505] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.643406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.651890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcba64d-8da3-4626-9253-c4eb3314224e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.656385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020f7c2-69b3-40ad-96bd-fce205de0a1b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.656807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.657472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.657748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.658024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.658762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.659070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.660663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.660949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.661571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.661848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.662120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.669675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.671405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.677233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 257/506] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.677233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.680132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 250/507] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:38.684387 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.689793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155e502-3788-4e72-8a7d-e5c93b92f731 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.690348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9b920-f635-429e-a319-bf7408e8c979 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.694237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.694772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.694892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.695086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.695355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.695446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.695682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.695992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.696084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.696345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.696715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.697025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.697932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.698621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.706579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 258/508] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.711324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.713715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 251/509] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.717900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.722320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa58f3-0b09-4d2d-8f5b-8b962e5c29e3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.726758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.727617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.728000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.728111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595921bd-cabf-411c-b2e4-bdc2a2b36c14 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.728426 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.732306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.733054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.733364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.733642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.735753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.737914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.744291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.746189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.751859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:38.757471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 259/510] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.757471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.766461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:38.766585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c51e6-a629-4f7d-b93d-31a0afacf5e1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.767824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 252/511] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.768410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.775471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.776305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.776656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.776998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.778095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72fdb3-be07-4101-945b-7c090f29c4f2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.782508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.783312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.783663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.784008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.787813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.789724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.793760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.795831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.807991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:38.817921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 260/512] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.818050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 12 03:59:38.818163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.818250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 253/513] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.818250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.827064 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910ab5c-8e16-4611-b04e-12f92bb7ae61 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.828251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97057937-4c45-4883-abf6-bb9b5c5f1385 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.831990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.832674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.832795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.833082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.833449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.833611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.833954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.834306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.834424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.834791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.835283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.835912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.836805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.837028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:38.837028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:38.837028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:38.838313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.848808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 254/514] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.853823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.861142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 261/515] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.861142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.863689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97bf50-c1f5-4196-b42c-8506c29230ea admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.868021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.868656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.868934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.869205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.870088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.870393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.871075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcbfcf-fc6c-4fc2-8b18-02ecce4295cd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.872211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.875553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.876192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.876482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.876765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.877524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.877837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.879414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.888989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 255/516] 10.222.0.31 () {56 vars in 1158 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.889816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.896256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 262/517] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.897239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.903813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b43d8-feeb-4765-a2b4-8975f7e0ce1d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.906733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125d91-5eaa-482d-bc0d-67d241abcc92 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.913541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.913541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.913541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.913541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.913822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.913822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.913822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.913822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.914091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=4509a13ccb074c5e9d8440755da77cc4) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.914091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.915199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.916420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.918374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.920767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 263/518] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/role_assignments?user.id=4509a13ccb074c5e9d8440755da77cc4&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.925885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.931893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8bf8d-3b95-41ea-b5b5-aaecc830b673 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.936580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.937401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.937694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.937973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.938072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:38.944252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 256/519] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:38.945235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.947553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.949554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.956811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f88215-6df1-4ce4-8830-0fc4d16bd59c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.960826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 264/520] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:38.961731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.962107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.962932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.963208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.963478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.971892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3514c-2e51-4575-b33f-b2572fcf7d59 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:38.972249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.974652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.976718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:38.977616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:38.977899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:38.978179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:38.978986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:38.979298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:38.981182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:38.990494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 12 03:59:38.997575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 265/521] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:38.997575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:38.997867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 257/522] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:39.001406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.010891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf515c-8638-45fb-b47e-1122f129c094 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.016231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.017058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.018657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.018657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.021702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6383-7d7e-44ca-9f1e-3b5ca5682c88 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.027099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.028195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.028680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.029218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.030560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.030983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.031343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.033092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.033992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.054231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:39.055773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 266/523] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:39.056848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.066527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 258/524] 10.222.0.31 () {56 vars in 1160 bytes} [Sat Feb 12 03:59:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.067355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34a742-c05c-4f74-9780-d36fb77a9218 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.067580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.072691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.074088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.074613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.075089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.076147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=6ee2e293bd2649f0b6d5aa13dc02ea89) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.076668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.078884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47db247-1076-4685-9002-651f7039f0e2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.079709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.085233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.086352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.086662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.086912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.087775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.088087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.088868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 267/525] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/role_assignments?user.id=6ee2e293bd2649f0b6d5aa13dc02ea89&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.089922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.090161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.101356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f9770-645c-42d8-9828-3942215f7d63 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.104596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 259/526] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.107192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.108343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.108838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.109812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.110593 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.122196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88643d-d90b-4ef0-baf5-827410874e43 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.126692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.130274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.141750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.142577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.142994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 268/527] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:39.143124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.143212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.149103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.155434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.157922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.165547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437849-60e2-44b2-a48b-d771de36bdaf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.171646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.172505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.172826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.173105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.174959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:39.177003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 260/528] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:39.183545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.187033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.189614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.195915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f233e-425d-48bf-bd28-402c3538462e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.201916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.203100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.203488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.203865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.204787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.205204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.206383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:39.206383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:39.206383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:39.207780 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.210342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:39.212147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 269/529] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:39.217730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.228933 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1b9b2-5f76-4e8e-a262-1d490cc007c9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.230400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 261/530] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.241152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.241913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.242192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.242522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.242677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.243267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.243577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.245359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.260319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 270/531] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:39.262151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee88270-b739-479a-9c35-be799a2e8696 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.266881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.272128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.273886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.274161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.274438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.275732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=d5f343848a5b4660bfcfe68795a7fcee) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.277199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.282785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.285636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14b8b-1e34-4235-82c5-6e92b38cadfc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.298666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 262/532] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/role_assignments?user.id=d5f343848a5b4660bfcfe68795a7fcee&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.299401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30705a5-4e41-4956-8b7e-ef8aec22f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.300257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30705a5-4e41-4956-8b7e-ef8aec22f3ed admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.300579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30705a5-4e41-4956-8b7e-ef8aec22f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.300856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30705a5-4e41-4956-8b7e-ef8aec22f3ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.315130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30705a5-4e41-4956-8b7e-ef8aec22f3ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.317300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30705a5-4e41-4956-8b7e-ef8aec22f3ed admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.337402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-e30705a5-4e41-4956-8b7e-ef8aec22f3ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:39.338621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 271/533] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:39.344777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.350705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642e4c-5432-4eab-9c8d-b4363ac96f2f None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.350996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642e4c-5432-4eab-9c8d-b4363ac96f2f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.351277 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642e4c-5432-4eab-9c8d-b4363ac96f2f None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.353426 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 272/534] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:39.357665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d0d4-4a7c-49af-a9b1-2013e764815d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.359052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f23f-910c-4e62-ad29-e91c70cd0854 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.359342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f23f-910c-4e62-ad29-e91c70cd0854 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.359626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793f23f-910c-4e62-ad29-e91c70cd0854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.367136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.367808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.368087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.368366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.369186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.369529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.371428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.392537 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6793f23f-910c-4e62-ad29-e91c70cd0854 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:39.393828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6793f23f-910c-4e62-ad29-e91c70cd0854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:39.399325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 263/535] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.407461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.418085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 273/536] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:39.435857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b585f4d-fb92-40bd-856d-c00c6e543ca4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.440734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.441518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.441808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.442088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.443028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=5157463790394bcbae9c0d7e5812f37f) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.443346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.445231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.458050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 264/537] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/role_assignments?user.id=5157463790394bcbae9c0d7e5812f37f&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.494862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f23f-910c-4e62-ad29-e91c70cd0854 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.507677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793f23f-910c-4e62-ad29-e91c70cd0854 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.518392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.519444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.519868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.520306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.535280 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.537557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.556548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:39.558399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 274/538] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:39.569460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.587040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8f453-4d40-49c4-8515-bf363c0a192c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.602618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b62440-d06b-41b4-af0c-1178de97e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.603288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b62440-d06b-41b4-af0c-1178de97e240 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.603574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b62440-d06b-41b4-af0c-1178de97e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.603855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b62440-d06b-41b4-af0c-1178de97e240 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.604602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b62440-d06b-41b4-af0c-1178de97e240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:39.604908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b62440-d06b-41b4-af0c-1178de97e240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.606607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b62440-d06b-41b4-af0c-1178de97e240 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.630761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 265/539] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:39.636291 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:39.650699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c387f-5e53-46c9-8fa5-55aab5ed25eb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:39.662069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369617ea-9347-4053-ade3-f65f17c77e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:39.662753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369617ea-9347-4053-ade3-f65f17c77e6a admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:39.663036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369617ea-9347-4053-ade3-f65f17c77e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:39.663310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369617ea-9347-4053-ade3-f65f17c77e6a admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:39.664051 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369617ea-9347-4053-ade3-f65f17c77e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:39.666235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369617ea-9347-4053-ade3-f65f17c77e6a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:39.766390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 275/540] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:39 2022] POST /identity/v3/users => generated 247 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:41.599325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58cb4-13ed-4cf9-81ba-b3aed17aa27c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.599917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58cb4-13ed-4cf9-81ba-b3aed17aa27c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.599917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b58cb4-13ed-4cf9-81ba-b3aed17aa27c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.601922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 266/541] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:41.608237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33574f09-1e14-4dd0-a2b4-e9c65db32604 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.608743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33574f09-1e14-4dd0-a2b4-e9c65db32604 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.608943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33574f09-1e14-4dd0-a2b4-e9c65db32604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.628759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f942-0a5a-42fd-add6-0ec85c504481 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.629048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f942-0a5a-42fd-add6-0ec85c504481 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.629351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2f942-0a5a-42fd-add6-0ec85c504481 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.631399 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 267/542] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:41.631710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-33574f09-1e14-4dd0-a2b4-e9c65db32604 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:41.632913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-33574f09-1e14-4dd0-a2b4-e9c65db32604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:41.636798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d909c86-cb0a-4272-8085-e2177c2da80d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.637469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d909c86-cb0a-4272-8085-e2177c2da80d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.638073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d909c86-cb0a-4272-8085-e2177c2da80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.647989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 276/543] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:41.666362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9d909c86-cb0a-4272-8085-e2177c2da80d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:41.667576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9d909c86-cb0a-4272-8085-e2177c2da80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:41.678793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 268/544] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:41.696290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33574f09-1e14-4dd0-a2b4-e9c65db32604 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.706255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33574f09-1e14-4dd0-a2b4-e9c65db32604 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.713694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.714487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.714774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.715056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.723304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d909c86-cb0a-4272-8085-e2177c2da80d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.732334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d909c86-cb0a-4272-8085-e2177c2da80d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.741954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:41.748799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:41.750487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.751269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.751547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.751816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.759226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 277/545] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:41.765150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.766736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:41.773740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:41.774994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 269/546] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:41.787759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.790324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239c1d9-963d-4f1a-bf51-2e7c9db153b9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.803340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.804021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.804303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.804581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.805383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:41.805692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:41.807336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:41.811319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212af7c8-5bd6-4fd5-84f2-c73c1ee5443d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.821897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 278/547] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:41.823479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.824155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.824442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.824718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.825517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:41.825827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:41.827568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:41.831113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.837516 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 270/548] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:41.845198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.849639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6b502-95a7-447a-a9f7-4776c5163756 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.861605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b849-6b21-4334-9ea9-9e6c4099002e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.864289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.865064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.865365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.865643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.877838 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.878614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.878894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.879167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.888068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:41.889962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:41.901679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:41.903540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:41.920858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:41.922770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 279/549] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:41.932842 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:41.934056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 271/550] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:41.934983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.942190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.953305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c0db-ef80-4b35-a65b-71bee1b5ef6c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.953557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948c77-89d4-40f2-b589-1b7e171579f1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:41.960503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.962138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:41.962782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.963058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.963329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.964059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:41.964360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:41.965999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:41.967808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:41.968184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:41.968517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:41.969259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:41.969591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:41.971163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:41.989255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 272/551] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:41.998649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:41.999060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 280/552] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.009364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.018003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd3969-b94a-4181-8921-688cf12ae140 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.022966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e026b-5052-42c2-bfb6-73f52c26712d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.029387 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.030176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.030455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.030754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.032640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6ea5-6d34-499f-9235-4a0db8871310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.033454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6ea5-6d34-499f-9235-4a0db8871310 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.033715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6ea5-6d34-499f-9235-4a0db8871310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.033983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6ea5-6d34-499f-9235-4a0db8871310 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.048252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.050269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.051872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6ea5-6d34-499f-9235-4a0db8871310 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.055132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6ea5-6d34-499f-9235-4a0db8871310 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.078839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-e4ed6ea5-6d34-499f-9235-4a0db8871310 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 03:59:42.080692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 281/553] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.082036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2ea5-dbb4-476b-9370-78629c1cbc71 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.082322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2ea5-dbb4-476b-9370-78629c1cbc71 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.082603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e2ea5-dbb4-476b-9370-78629c1cbc71 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.084274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 282/554] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:42.085881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 03:59:42.087099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 273/555] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 03:59:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.087826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e2ea5-dbb4-476b-9370-78629c1cbc71 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.093141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.103927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393e92-a400-44f0-8339-e56f8051b192 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.105203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e2ea5-dbb4-476b-9370-78629c1cbc71 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.108623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70072851-66f8-4aad-ba18-da2c766622d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.109841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072851-66f8-4aad-ba18-da2c766622d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.110215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072851-66f8-4aad-ba18-da2c766622d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.110459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648f68d-c973-4770-8352-a0d5488a3125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.110646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70072851-66f8-4aad-ba18-da2c766622d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.111099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f68d-c973-4770-8352-a0d5488a3125 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.111311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70072851-66f8-4aad-ba18-da2c766622d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.111492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f68d-c973-4770-8352-a0d5488a3125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.111642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70072851-66f8-4aad-ba18-da2c766622d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.111779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f68d-c973-4770-8352-a0d5488a3125 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.112453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648f68d-c973-4770-8352-a0d5488a3125 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.112757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648f68d-c973-4770-8352-a0d5488a3125 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.113456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70072851-66f8-4aad-ba18-da2c766622d0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.114601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648f68d-c973-4770-8352-a0d5488a3125 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.135195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 283/556] 10.222.0.31 () {56 vars in 1158 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.135195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb45e-2d0b-4ea9-8158-bd224983f726 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.135195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb45e-2d0b-4ea9-8158-bd224983f726 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.135482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb45e-2d0b-4ea9-8158-bd224983f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.135822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 274/557] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.137523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a2265-3663-48b8-b0f5-6df524ae12fb None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.138030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a2265-3663-48b8-b0f5-6df524ae12fb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.138447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a2265-3663-48b8-b0f5-6df524ae12fb None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.140827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 275/558] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:42.142874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a2265-3663-48b8-b0f5-6df524ae12fb None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.155547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b5bfb45e-2d0b-4ea9-8158-bd224983f726 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:42.157296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b5bfb45e-2d0b-4ea9-8158-bd224983f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:42.160412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a2265-3663-48b8-b0f5-6df524ae12fb None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.165126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 284/559] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:42.165702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb45e-2d0b-4ea9-8158-bd224983f726 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.169806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39cf6-4eb7-4f32-9bd5-89c36311f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.171084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39cf6-4eb7-4f32-9bd5-89c36311f4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.172629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39cf6-4eb7-4f32-9bd5-89c36311f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.173124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39cf6-4eb7-4f32-9bd5-89c36311f4b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.175689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb45e-2d0b-4ea9-8158-bd224983f726 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.180568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.181479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.181865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.182598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.187133 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39cf6-4eb7-4f32-9bd5-89c36311f4b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.189160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39cf6-4eb7-4f32-9bd5-89c36311f4b2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.193269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.195039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.209651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-29f39cf6-4eb7-4f32-9bd5-89c36311f4b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:42.211254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 276/560] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.211822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:42.212719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a045f34-2f5f-4591-96db-e2c22f407e86 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.213139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a045f34-2f5f-4591-96db-e2c22f407e86 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.213287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 285/561] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.213682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a045f34-2f5f-4591-96db-e2c22f407e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.214064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.223941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a27d1a-643a-43d2-b003-205fcdcddb0a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.228285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.229022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.229326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.229616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.233350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8a045f34-2f5f-4591-96db-e2c22f407e86 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:42.234934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8a045f34-2f5f-4591-96db-e2c22f407e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:42.239863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:42.257648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 277/562] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:42.257796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:42.257872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a045f34-2f5f-4591-96db-e2c22f407e86 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.257938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 286/563] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.257938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.268020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a045f34-2f5f-4591-96db-e2c22f407e86 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.272152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6fef-0887-4ea0-b63a-34b70e8ec6b7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.272884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.273772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.274350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.274700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.275512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.275892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.277572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.284991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.285867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.286145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.286420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.287152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.287454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.289013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.291450 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 278/564] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.292183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.301628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9202f39-5fb1-4539-8acd-d86de219bbda admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.304579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 287/565] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.306073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.306738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.307020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.307294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.308043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.308558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.309331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.309962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.319221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e9af-de26-4ea6-9bb9-b56a4ca58c13 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.319339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 279/566] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.319850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.327717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.329045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.329348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.329458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21cedb-215b-4bd9-a8a5-3f3d0497683f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.329644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.333766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.334523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.334804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.335075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.340017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:42.342410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.344368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.346789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:42.352594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 288/567] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.352594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.360463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:42.361800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 280/568] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.362510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.366286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0466a1-f606-4dda-b568-1985d12069de admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.370730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.371486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.371763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.372032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.372303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19195214-91db-468d-b54e-cf42a6ecad17 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.377177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.378005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.378358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.378704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.379609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.381577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.389408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.391826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.394740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:42.400396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 289/569] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.400396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.409799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3d0bf-ce1f-40e5-b5c1-c3a029b77147 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.411018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:42.412423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 281/570] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.413113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.418720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.419373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.419654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.419921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.420675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.420979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.422632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.423322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2923c-03a7-4a23-ba81-31aac4621df0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.427720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.428409 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.428756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.429096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.429915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.430216 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.435942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 290/571] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.436083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.436174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.445144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117dabbf-d8db-4aae-91ec-8a0d89d98933 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.447839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 282/572] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.448512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.454337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.455046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.455398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.455743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.456530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.456832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.458047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994868-25de-4c71-acf2-586dd7676aba admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.458672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.462691 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.463309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.463588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.463864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.464611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.464890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.466498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.475485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 291/573] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.475485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.481307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 283/574] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.482232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.489413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21807cb-c18e-43a5-a93a-a7cc69ad55c7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.492165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d84f2d-0f72-4d1b-b7a7-acf545c9281f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.493818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.494584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.494864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.495125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.497199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.498167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.498518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.498858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/6ee2e293bd2649f0b6d5aa13dc02ea89/roles/a24e0024c3264885b078b73325e5b2ed` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.505978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.507833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.513310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=6ee2e293bd2649f0b6d5aa13dc02ea89, role_id=a24e0024c3264885b078b73325e5b2ed)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.516536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.524395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:42.525637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 292/575] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.526374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.536254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefbbb5-8390-4315-af6d-4a52633d6850 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.540871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.541899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.542181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.542493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/4509a13ccb074c5e9d8440755da77cc4/roles/a24e0024c3264885b078b73325e5b2ed` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.559485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=4509a13ccb074c5e9d8440755da77cc4, role_id=a24e0024c3264885b078b73325e5b2ed)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.562787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.589156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 284/576] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:42 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/6ee2e293bd2649f0b6d5aa13dc02ea89/roles/a24e0024c3264885b078b73325e5b2ed => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:42.589875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.621332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 293/577] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:42 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/4509a13ccb074c5e9d8440755da77cc4/roles/a24e0024c3264885b078b73325e5b2ed => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:42.621332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.716186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aae03-f2f9-4296-9ef9-30a3cff2bb1b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.760515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed10ac-4166-4ac8-93d7-892c2c2a7ace admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.773131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.773846 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.774183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.774463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.775218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.775523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.777964 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.791208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 294/578] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.797133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.808539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e018581-7223-4c41-88aa-3e8aafe8acae admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.813650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.814452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.814737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.815017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.820949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2a19d-a87d-4530-9d75-6de63f747eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.820949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a19d-a87d-4530-9d75-6de63f747eec admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.820949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a19d-a87d-4530-9d75-6de63f747eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.820949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2a19d-a87d-4530-9d75-6de63f747eec admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.828757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.830849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.831450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2a19d-a87d-4530-9d75-6de63f747eec admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.833804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2a19d-a87d-4530-9d75-6de63f747eec admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.848340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 12 03:59:42.848528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-1fe2a19d-a87d-4530-9d75-6de63f747eec admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 12 03:59:42.850007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 295/580] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:42.850125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 285/580] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:42.851280 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba688c5-58a1-43f2-8047-ca9900d4af20 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.851490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba688c5-58a1-43f2-8047-ca9900d4af20 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.851764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba688c5-58a1-43f2-8047-ca9900d4af20 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.853686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 296/581] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:42.855012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.858536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba688c5-58a1-43f2-8047-ca9900d4af20 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.867839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7fc5-1972-4098-a238-2a1c8fbfa185 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.871636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba688c5-58a1-43f2-8047-ca9900d4af20 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.872964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2b2b1-12cd-4f8d-832f-ec7bcef51d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.873647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b2b1-12cd-4f8d-832f-ec7bcef51d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.873937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b2b1-12cd-4f8d-832f-ec7bcef51d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.874195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b2b1-12cd-4f8d-832f-ec7bcef51d87 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.875171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2b2b1-12cd-4f8d-832f-ec7bcef51d87 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.875485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2b2b1-12cd-4f8d-832f-ec7bcef51d87 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.877336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2b2b1-12cd-4f8d-832f-ec7bcef51d87 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.878460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.879283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.879566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.879843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.880695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:42.881080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.882935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.897024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 286/582] 10.222.0.31 () {56 vars in 1160 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:42.898628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5536168-c3a4-4ef7-85cb-7b4b0d30f4fa None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.899102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5536168-c3a4-4ef7-85cb-7b4b0d30f4fa None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.899657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5536168-c3a4-4ef7-85cb-7b4b0d30f4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.905138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 297/583] 10.222.0.31 () {56 vars in 1158 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:42.911437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.918571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0440e-a233-4cee-a6ea-89941d826ee3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.922296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-d5536168-c3a4-4ef7-85cb-7b4b0d30f4fa None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:42.923581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.923940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d5536168-c3a4-4ef7-85cb-7b4b0d30f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:42.924404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.924687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.925013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.932720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 287/584] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:42.933777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5536168-c3a4-4ef7-85cb-7b4b0d30f4fa None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.945781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.947888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.953159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5536168-c3a4-4ef7-85cb-7b4b0d30f4fa None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.962131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.963224 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.963509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.963789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.971666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:42.973152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 298/585] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:42.977443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:42.977443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:42.978738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:42.988870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850ca26-4c06-4100-937a-ea9ec5ada269 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:42.993467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:42.994237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:42.994524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:42.994802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:42.998135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:43.000124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 288/586] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.001253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.006743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:43.011647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dc89f-6498-42be-9f27-0479d2bb39d2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.013730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:43.016724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.017671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.018141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.018578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.019500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.019648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 299/587] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.020146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.020471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.022396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.034890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e05d-5ab2-4514-a694-e0734067c766 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.035471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 289/588] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.037338 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.045079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.046189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.046758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.047175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.048079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.048490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.050273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.052126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2c6e-92e6-481d-98a8-9706c5ccc681 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.056824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.057714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.058192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.058649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.059571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.060047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.061843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.065420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 300/589] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.066549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.071694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 290/590] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.072783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.081673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999331-3424-497d-84b0-4d5dcbdc00c9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.086638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.087499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.087848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.088196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.089244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385522c1-b5b1-424d-9f64-4c63af0286e4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.094626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.095613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.096166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.096331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.096770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.098343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.105166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.107348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.111539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:43.113107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 301/591] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.117877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.128178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41a6b-3006-457a-ab9f-ce73ab3363bd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.129658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:43.131323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 291/592] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.132694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.133188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.134206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.134585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.134959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.143209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c9bf3-6e80-491e-b018-3d30ea84370c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.146454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.148125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.148554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.149133 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.149624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.150059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.150981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.151428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.153556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.170959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:43.170959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 302/594] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.171375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 292/594] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.172407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.173999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.182283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fc347-865c-41c5-9add-db573f928552 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.183961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c5a97-ef7c-4250-8356-f927cd248bec admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.188373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.189230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.189773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.189944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.190220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.190496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.190811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.191268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/5157463790394bcbae9c0d7e5812f37f/roles/a24e0024c3264885b078b73325e5b2ed` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.191366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.191635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.193578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.205615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 303/595] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.206476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.207333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=5157463790394bcbae9c0d7e5812f37f, role_id=a24e0024c3264885b078b73325e5b2ed)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.210453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.216523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68b621-aeef-4d2e-aa5f-e9f33c9fcea0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.221482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.222106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.222390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.222670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.223392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.223699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.225241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.237005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 304/596] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.241877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.251571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d5be-69d3-40aa-9cd9-a2387f2862cc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.255985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.256856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.257157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.257470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/d5f343848a5b4660bfcfe68795a7fcee/roles/a24e0024c3264885b078b73325e5b2ed` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.272114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=d5f343848a5b4660bfcfe68795a7fcee, role_id=a24e0024c3264885b078b73325e5b2ed)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.275462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.290667 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 293/597] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:43 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/5157463790394bcbae9c0d7e5812f37f/roles/a24e0024c3264885b078b73325e5b2ed => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:43.291700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.357346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 305/598] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:43 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/d5f343848a5b4660bfcfe68795a7fcee/roles/a24e0024c3264885b078b73325e5b2ed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:43.383489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e603-bc25-4b82-8899-f5a725695099 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.462497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.463315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.463599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.463879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.476043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.478801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.497613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 03:59:43.499080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 294/599] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.505572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.516611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b83d2-e163-4fab-9a2e-8304ff550f48 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.525401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.526373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.526804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.527222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.528256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.528716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.530824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.554444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 306/600] 10.222.0.31 () {56 vars in 1156 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.559314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.569732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3fbd-1864-43f5-9eb5-0446d95b0810 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.575954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.576599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.576875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.577145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.590832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.592603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.603383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 295/601] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:43.612795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.622964 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60b877-f747-4d58-80bf-229bff66e9e6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.637313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.638053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.638342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.638623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.656559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.658413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.682616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:43.688762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 307/602] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.690190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.703876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e8787-053a-48df-adc6-2906055940c6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.714660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.715627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.716160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.716644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.718070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.718608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.720492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.739122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 296/603] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.744268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.758990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955d80-a832-4c71-9c38-128cd7f14b76 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.773395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.774196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.774478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.774754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.782921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.784889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.803174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:43.804354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 308/604] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:43.814650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.830261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63d538-e7b7-4d65-86a6-b8424158a0c6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.837641 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b648-97ba-4643-8e25-ea11f71a1edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.838295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b648-97ba-4643-8e25-ea11f71a1edb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.838579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b648-97ba-4643-8e25-ea11f71a1edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.838853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b648-97ba-4643-8e25-ea11f71a1edb admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.839653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b648-97ba-4643-8e25-ea11f71a1edb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.839964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b648-97ba-4643-8e25-ea11f71a1edb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.841852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b648-97ba-4643-8e25-ea11f71a1edb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.863512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 297/605] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:43.869449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:43.883319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53442fe2-6610-4987-bd7c-a9f016725056 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:43.893050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160bdcf-9778-4999-b341-192f55a2cf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:43.893658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160bdcf-9778-4999-b341-192f55a2cf70 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:43.893944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160bdcf-9778-4999-b341-192f55a2cf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:43.894222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160bdcf-9778-4999-b341-192f55a2cf70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:43.895064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160bdcf-9778-4999-b341-192f55a2cf70 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=2f8eac55c400472296dfec3a113799d7) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:43.895375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160bdcf-9778-4999-b341-192f55a2cf70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:43.897202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160bdcf-9778-4999-b341-192f55a2cf70 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:43.909758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 309/606] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:43 2022] GET /identity/v3/role_assignments?user.id=2f8eac55c400472296dfec3a113799d7&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:45.246468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e420c2-5caa-4299-9bdc-08d2bca50f65 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.246977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e420c2-5caa-4299-9bdc-08d2bca50f65 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.247081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e420c2-5caa-4299-9bdc-08d2bca50f65 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.249018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 298/607] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:45.255082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bca0ee-1478-4c0f-8544-6bf2e4167bdf None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.255502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bca0ee-1478-4c0f-8544-6bf2e4167bdf None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.255672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bca0ee-1478-4c0f-8544-6bf2e4167bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.282399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-27bca0ee-1478-4c0f-8544-6bf2e4167bdf None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:45.284407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-27bca0ee-1478-4c0f-8544-6bf2e4167bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:45.294771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 310/608] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:45.338777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e420c2-5caa-4299-9bdc-08d2bca50f65 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.355057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e420c2-5caa-4299-9bdc-08d2bca50f65 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.359838 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.360812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.361174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.361472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.376132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:45.383013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:45.384214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 299/609] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:45.390176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bca0ee-1478-4c0f-8544-6bf2e4167bdf None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.399366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bca0ee-1478-4c0f-8544-6bf2e4167bdf None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.409930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.410605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.410889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.411165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.411937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:45.412241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.413867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.423816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 311/610] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:45.429289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.442551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633d653-ea9b-4ab7-9d03-db5796778563 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.449900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.450690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.450970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.451246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.463707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.465607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.483217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:45.487377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 300/611] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:45.492144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.564124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda73c6-7083-4b1a-a8c2-8d8d2d408d29 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.564124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.564124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.564124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.564532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.564532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:45.564532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.564532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.564532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 312/612] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:45.564814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.564814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adc65e-2d7f-4f4c-a98e-ad57e44d2f14 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.574891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.575683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.575960 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.576236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.590836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.592975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.612065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 03:59:45.613686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 301/613] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:45.618991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.633074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49b2c3-b321-48b2-a287-813cde5e6331 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.641308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.644422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.644422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.644422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.644422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:45.644422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.646874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.673895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 313/614] 10.222.0.31 () {56 vars in 1158 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:45.679520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.694224 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346f03-3237-416b-b9d3-2246900a5a96 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.705896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.706585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.706875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.707152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.718024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.719847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.734770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 302/615] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:45.740465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.755412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d62759-ba2e-45af-b294-914847b3ac16 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.764027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a609b7-f1c5-429f-b6a2-c81f561f3420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.765585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a609b7-f1c5-429f-b6a2-c81f561f3420 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.766111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a609b7-f1c5-429f-b6a2-c81f561f3420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.766588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a609b7-f1c5-429f-b6a2-c81f561f3420 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.781114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a609b7-f1c5-429f-b6a2-c81f561f3420 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.783279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a609b7-f1c5-429f-b6a2-c81f561f3420 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.808174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-70a609b7-f1c5-429f-b6a2-c81f561f3420 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:45.810006 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 314/616] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:45.815355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.833446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c7aec-023e-414c-b528-4b5bb2634581 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.833754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c7aec-023e-414c-b528-4b5bb2634581 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.834061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c7aec-023e-414c-b528-4b5bb2634581 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.836267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 315/617] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:45.839509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa9b54-94a4-4ad9-bea5-70befd871890 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.841498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7471c-e6c9-44bf-8231-ebe38c51332e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.841788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7471c-e6c9-44bf-8231-ebe38c51332e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.842067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7471c-e6c9-44bf-8231-ebe38c51332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.846977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.847624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.847901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.848172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.848900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:45.849202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.850809 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.861774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-31c7471c-e6c9-44bf-8231-ebe38c51332e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:45.862962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-31c7471c-e6c9-44bf-8231-ebe38c51332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:45.869936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 303/618] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:45.875808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.885421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 316/619] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:45.891835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85150c0b-5411-4b0a-9c4e-cdb374bc82a4 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.892123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85150c0b-5411-4b0a-9c4e-cdb374bc82a4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.892401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85150c0b-5411-4b0a-9c4e-cdb374bc82a4 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.894520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 317/620] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:45.898365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909d4d-12fe-4ab9-a31c-594715512970 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.899290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382aa4c-a45b-4e35-8241-f89b02112cdc None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.899580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382aa4c-a45b-4e35-8241-f89b02112cdc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.899864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382aa4c-a45b-4e35-8241-f89b02112cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.903331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.904256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.904535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.904803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.913878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.916362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.919195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e382aa4c-a45b-4e35-8241-f89b02112cdc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:45.920305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e382aa4c-a45b-4e35-8241-f89b02112cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:45.930164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:45.931591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 304/622] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:45.932445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.932553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 318/622] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:45.937813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382aa4c-a45b-4e35-8241-f89b02112cdc None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.943419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668ad0-04bd-41f9-a9dc-fc4df6bdacc5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.949129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3d1ba-e5ee-48d5-bec1-22161c230dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.950175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d1ba-e5ee-48d5-bec1-22161c230dec admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.950633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d1ba-e5ee-48d5-bec1-22161c230dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.951079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3d1ba-e5ee-48d5-bec1-22161c230dec admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.951686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382aa4c-a45b-4e35-8241-f89b02112cdc None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:45.965304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:45.965304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.965304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.965304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.965670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:45.965670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:45.965670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:45.976717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3d1ba-e5ee-48d5-bec1-22161c230dec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:45.982620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 319/623] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:45.983879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.988395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-cef3d1ba-e5ee-48d5-bec1-22161c230dec admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:45.989622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 305/624] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:45.991150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020de68a-2551-4d87-82a6-5d950fe3b219 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:45.991437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020de68a-2551-4d87-82a6-5d950fe3b219 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:45.991715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020de68a-2551-4d87-82a6-5d950fe3b219 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:45.993509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 306/625] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:45.994137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020de68a-2551-4d87-82a6-5d950fe3b219 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:45.995264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26127-0f18-439d-924d-9ba39c580efe admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.000731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025d470-b1f4-45af-a2f5-3146f282cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.001749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d470-b1f4-45af-a2f5-3146f282cc0a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.002228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d470-b1f4-45af-a2f5-3146f282cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.002689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d470-b1f4-45af-a2f5-3146f282cc0a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.007021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020de68a-2551-4d87-82a6-5d950fe3b219 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.011240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.011856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.012134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.012408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.013121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025d470-b1f4-45af-a2f5-3146f282cc0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:46.013303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=6ee2e293bd2649f0b6d5aa13dc02ea89) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.013581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.015988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.020561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-b025d470-b1f4-45af-a2f5-3146f282cc0a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:46.021853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 307/626] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/role_assignments?user.id=6ee2e293bd2649f0b6d5aa13dc02ea89&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.029449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.029634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 320/627] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.029634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32dfa7-ac24-4d7b-b649-481131cee094 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.029634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32dfa7-ac24-4d7b-b649-481131cee094 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.029634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32dfa7-ac24-4d7b-b649-481131cee094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.040480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb925ba-4149-42de-a8d4-585290922497 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.047676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-8c32dfa7-ac24-4d7b-b649-481131cee094 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:46.048321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.049172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8c32dfa7-ac24-4d7b-b649-481131cee094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:46.049490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.049945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.050475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.051551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.052106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.054295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.058394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 321/628] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:46.059520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32dfa7-ac24-4d7b-b649-481131cee094 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.066650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 308/629] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.073439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32dfa7-ac24-4d7b-b649-481131cee094 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.079033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.089088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.089802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.090087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.090362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.091137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.091445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.093079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.104332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27052-eb19-4145-a1fb-9de3639e6445 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.104749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 322/630] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.106407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.116700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.117584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.117866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.118284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.120853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aebcfe-0d5c-4421-bd06-525f453342db admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.126243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.127365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.127848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.128394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.131286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.133234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.142511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:46.149990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:46.151672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:46.157489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 309/631] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.157489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.157696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 323/632] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.165308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.168748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9882d-a0b7-4e6e-8b91-670ee9983524 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.173556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.174345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.174624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.174892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.180113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f60f4d-52ac-43b1-b73c-7d20236068b9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.186570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.186882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.188320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.188796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.189105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.189520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.190464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.190980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.193438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.211856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 324/633] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.211856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.212679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:46.214283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 310/634] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.215066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.222786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa081b9-8eb4-4929-a5fa-10a5ca7f4f4e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.228759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.229453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.229735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.230017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.230782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.231089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.232545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c859f-0958-4922-a0a3-62e7d28933f4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.232653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.237469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.238553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.238840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.239111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.242370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 325/635] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.243470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.250770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.253722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.255522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8636ac-e736-476b-aaa2-492d044f75b4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.263749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.264244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.264527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.264802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.267046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.267046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.267829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.270879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 03:59:46.271761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 311/636] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.272716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.287557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 326/637] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.288358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.290827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567507-1dd6-4b39-9533-d1c361ddadef admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.295508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.296827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.297114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.297465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.299698 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d763c3-e25e-4217-9bf5-7d16d1b06f24 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.306902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.307561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.307843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.308116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.308212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.308960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.309269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.310031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.311109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.328055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:46.329218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 312/638] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.330031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.330841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 327/639] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.336190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.344027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84d9a-9e24-4a16-8bcb-7ce371a62f11 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.346010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd1d78-f52c-4e8e-a96e-2280bfd350ce admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.348468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.349233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.349542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.349816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.350906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.351651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.352002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.352351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.357566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.360221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.361920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.363777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.377307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 328/640] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 03:59:46.377307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.378801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 12 03:59:46.380153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 313/641] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.383156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.386343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3d303-726f-4fd5-945d-f5d09e6d5513 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.391525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.392183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.392450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.392724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.393482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.393792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.395364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.396537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b486a-8013-4b79-a26b-0dece55f0015 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.402000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.403208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.403783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.404251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.407134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 329/642] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.411541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.422645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.423845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9efd02-603a-424f-8dc6-5750c39520a1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.424586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.429117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.430153 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.430651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.431125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.432292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.432815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.435013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.443186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:46.444835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 314/643] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.450738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.460486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 330/644] 10.222.0.31 () {56 vars in 1158 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.465374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6cbec-bfd9-4c54-a7fb-e235099686fd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.466536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.469170 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.470348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.470805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.471281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.478495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909d619-d042-4fb6-bf7a-cb6c78d3755a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.481536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.483582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.484529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.485306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.485779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.486194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.487065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.487607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.489245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.505740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 331/645] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.505740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.509447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 12 03:59:46.511935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 315/646] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.512988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.519655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e1a1f-5ba5-4a43-a8b8-89a7c4ceb455 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.524221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393cb6-0dfb-4d93-98de-54227f994ab6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.524332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.524970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.525250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.525598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.529921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.531155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.532070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.532537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.533890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.536301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.540416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.543261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.547677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 332/647] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:46.548560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.561493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:46.562729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d0037-e850-4dcc-8375-1c709676e847 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.563344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 316/648] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.567750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.568509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.568914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.569023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.569389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.570394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.570799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.572810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.581562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b4b42-7add-447e-8da5-ea28aa220b56 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.587922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.588876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.589315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.589725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.599279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 333/649] 10.222.0.31 () {56 vars in 1160 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.600318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.603074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.605037 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.612154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218665-3a8f-4077-ab5e-56e62e43cf9b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.618055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.618815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.619232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.619609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.620590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.620997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.623109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.624293 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:46.626507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 317/650] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.627580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.638239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b453e-b13e-425d-849e-7d5471b06bd8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.645762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 334/651] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.645762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.652130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.653367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.653677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.654004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.659304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085bb18-86cd-4c38-a31e-ce427a3c2ec6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.663842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.664338 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.664959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.665474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.665946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.666263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.667083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.667588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.669359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.676271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 318/652] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:46.676888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.682735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 335/653] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.683782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.694208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ae409-2a09-4970-b6d4-9f04953827f0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.695174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da50d7-ec75-4619-9a0d-42008a77a4d5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.699633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.700069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa58e35-81df-4578-9679-6d9dd7f0b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.700281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.700542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.700815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.701685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=4509a13ccb074c5e9d8440755da77cc4) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.701947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58e35-81df-4578-9679-6d9dd7f0b074 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.702045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.702499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58e35-81df-4578-9679-6d9dd7f0b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.703048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58e35-81df-4578-9679-6d9dd7f0b074 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.703852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.710099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 319/654] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/role_assignments?user.id=4509a13ccb074c5e9d8440755da77cc4&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.717403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.729626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7241f2-d316-4b76-8e0a-3a23ffe35da9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.731558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa58e35-81df-4578-9679-6d9dd7f0b074 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.733456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa58e35-81df-4578-9679-6d9dd7f0b074 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.746212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968c793-a72c-4c06-bd9c-b4c00771b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.747017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968c793-a72c-4c06-bd9c-b4c00771b9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.747300 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968c793-a72c-4c06-bd9c-b4c00771b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.747574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968c793-a72c-4c06-bd9c-b4c00771b9c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.755985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-0fa58e35-81df-4578-9679-6d9dd7f0b074 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:46.757239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 336/655] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.758694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd2d8-56f2-4340-83c8-e3dc8225df94 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.758984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd2d8-56f2-4340-83c8-e3dc8225df94 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.759264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd2d8-56f2-4340-83c8-e3dc8225df94 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.761155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 337/656] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:46.763253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968c793-a72c-4c06-bd9c-b4c00771b9c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.765774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968c793-a72c-4c06-bd9c-b4c00771b9c2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.766077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cd2d8-56f2-4340-83c8-e3dc8225df94 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.782232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a968c793-a72c-4c06-bd9c-b4c00771b9c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:46.784282 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cd2d8-56f2-4340-83c8-e3dc8225df94 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.784501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 320/657] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.786049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a66d-6f65-4b60-a54d-6d1f6cd82607 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.786615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a66d-6f65-4b60-a54d-6d1f6cd82607 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.787138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a66d-6f65-4b60-a54d-6d1f6cd82607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.789655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.790519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.790913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.791363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.792323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.792797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.794907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.808603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-edc8a66d-6f65-4b60-a54d-6d1f6cd82607 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:46.810269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-edc8a66d-6f65-4b60-a54d-6d1f6cd82607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:46.813337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 338/658] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.814206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.822627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 321/659] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:46.823291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a66d-6f65-4b60-a54d-6d1f6cd82607 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.835625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a66d-6f65-4b60-a54d-6d1f6cd82607 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.838173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23618bbd-50d1-42b0-9eab-1630a4a1bce1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.844832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.846381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.848571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.849320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.851550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.851882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.852475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.853419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.853702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.853865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.853971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.863810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.866741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.871772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 339/660] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.872658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.883193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:46.884983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 322/661] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.886478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.894624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353439d2-db12-4bcf-9c8b-a187427b7f44 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.899043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55648688-29f1-4ed0-9523-ffd0adb33cfa admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.899432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.900220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.900508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.900784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.904270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.904905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.905192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.905501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.906383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=d5f343848a5b4660bfcfe68795a7fcee) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.906699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.908659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.913557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:46.915633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 323/662] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/role_assignments?user.id=d5f343848a5b4660bfcfe68795a7fcee&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.916421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.921598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:46.924008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 340/663] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:46.929880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.931023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb143e-e62f-4adc-81c7-616f5e5f4904 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.937462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.938171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.938452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.938733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.939559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.939861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.941769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.943592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3af6c4-f33c-4ec9-a7a9-572f0b91c8bb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.950591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.951717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.953493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.954358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.955473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.955988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.956142 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 324/664] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:46.958061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.966853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.970096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 341/665] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:46.979287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:46.982664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed8a1a-2ba9-4070-aa41-11a6cfef8925 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.987635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:46.988296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:46.988580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:46.988859 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:46.989760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=5157463790394bcbae9c0d7e5812f37f) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:46.990089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:46.992080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:46.992874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8207cb-82e5-4338-8585-4795c2bee0c7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:46.999228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 325/666] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/role_assignments?user.id=5157463790394bcbae9c0d7e5812f37f&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:47.000167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.001193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.001724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.002209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.014696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.017116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.037222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:47.039389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 342/667] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:47.044954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.056362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390e20d-8321-44f5-82f1-6c2d25df1d98 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.061545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.062840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.063362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.063843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.064828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:47.065393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.067287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.083854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 326/668] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:47.089364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.100164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243d54b-cc5c-4441-a7e7-91d1da82b3a4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.105326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.106545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.107042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.107519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.116842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.119283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.134665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 03:59:47.136681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 343/669] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:47.142545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.153555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba517-269a-465d-b91e-0760416d1113 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.159117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.159794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.160072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.160345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.161196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:47.161543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.163533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.191446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 327/670] 10.222.0.31 () {56 vars in 1156 bytes} [Sat Feb 12 03:59:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:47.196889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.209693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26573-9943-45c6-a967-59edef29ba6a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.215237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.216024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.216309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.216586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.228819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.230887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.250430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:47.251952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 344/671] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:47.257612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.271200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b809-433f-47d4-83b5-3cf065744724 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.276823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.277713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.278177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.278628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.279726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:47.280204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.282045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.294699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 328/672] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:47.300465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.312148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077ec5c-a649-487b-8033-0fd05646641f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.317797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.318639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.318923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.319250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.326958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.328997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.343174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:47.344720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 345/673] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:47.350166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.366397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a59942-8de8-43c9-8f0f-e35f6dee0d77 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.373769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e9b4a-40de-4087-bcbd-88e81c1cd626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.374489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9b4a-40de-4087-bcbd-88e81c1cd626 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.374807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9b4a-40de-4087-bcbd-88e81c1cd626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.375088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9b4a-40de-4087-bcbd-88e81c1cd626 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.375912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9b4a-40de-4087-bcbd-88e81c1cd626 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:47.376235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9b4a-40de-4087-bcbd-88e81c1cd626 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.378191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9b4a-40de-4087-bcbd-88e81c1cd626 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.396359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 329/674] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:47.402279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:47.417337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac92e45-ce96-4164-bf5d-69b341362be4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:47.430774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce092be7-4960-4b1d-a987-01375ddc7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:47.432104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce092be7-4960-4b1d-a987-01375ddc7989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:47.432580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce092be7-4960-4b1d-a987-01375ddc7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:47.433029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce092be7-4960-4b1d-a987-01375ddc7989 admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/2f8eac55c400472296dfec3a113799d7/roles/a24e0024c3264885b078b73325e5b2ed` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:47.449705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce092be7-4960-4b1d-a987-01375ddc7989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=2f8eac55c400472296dfec3a113799d7, role_id=a24e0024c3264885b078b73325e5b2ed)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:47.452767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce092be7-4960-4b1d-a987-01375ddc7989 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:47.535520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 346/675] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:47 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/2f8eac55c400472296dfec3a113799d7/roles/a24e0024c3264885b078b73325e5b2ed => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:48.649497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a964a-5ba0-4217-be7e-4edacaf18448 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:48.650360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a964a-5ba0-4217-be7e-4edacaf18448 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:48.650815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a964a-5ba0-4217-be7e-4edacaf18448 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:48.652708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 330/676] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:48.658203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f60e-505e-4e15-957a-7ff923e31e6f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:48.658935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f60e-505e-4e15-957a-7ff923e31e6f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:48.659361 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54f60e-505e-4e15-957a-7ff923e31e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:48.690247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1b54f60e-505e-4e15-957a-7ff923e31e6f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:48.691992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1b54f60e-505e-4e15-957a-7ff923e31e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:48.753890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 347/677] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:48.798772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a964a-5ba0-4217-be7e-4edacaf18448 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:48.818851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a964a-5ba0-4217-be7e-4edacaf18448 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:48.825862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:48.826852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:48.827283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:48.828220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:48.829040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:48.830235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:48.830235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:48.830235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:48.831394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:48.845447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 12 03:59:48.853727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 331/678] 10.222.0.31 () {56 vars in 1150 bytes} [Sat Feb 12 03:59:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:48.859896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f60e-505e-4e15-957a-7ff923e31e6f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:48.874180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54f60e-505e-4e15-957a-7ff923e31e6f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:48.883693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:48.884423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:48.884702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:48.884973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:48.885719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:48.886025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:48.887028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:48.887028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:48.887028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:48.887889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262fbd0-68c4-43b8-a1d0-27c5dd0806e2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:48.897289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 348/679] 10.222.0.31 () {56 vars in 1145 bytes} [Sat Feb 12 03:59:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:48.902515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:48.916707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4dd4-f054-4ea6-bf58-e7d807e9784e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:48.925893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:48.926786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:48.927250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:48.927705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:48.928603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:48.929085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:48.930306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:48.930306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:48.930306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:48.931486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a9936-51bf-4255-a7e8-304dfd2e33f2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:48.938282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 332/680] 10.222.0.31 () {56 vars in 1145 bytes} [Sat Feb 12 03:59:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:49.478180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d270c5-bedd-4d64-abeb-b3a9722b7cd6 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.478809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d270c5-bedd-4d64-abeb-b3a9722b7cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.479267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d270c5-bedd-4d64-abeb-b3a9722b7cd6 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.481524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 349/681] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:49.487125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ee7f-43ae-4c03-8a05-c11c23d1db0d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.487648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ee7f-43ae-4c03-8a05-c11c23d1db0d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.488106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ee7f-43ae-4c03-8a05-c11c23d1db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.514644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-10b4ee7f-43ae-4c03-8a05-c11c23d1db0d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:49.516724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-10b4ee7f-43ae-4c03-8a05-c11c23d1db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:49.527104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 333/682] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:49.562567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d270c5-bedd-4d64-abeb-b3a9722b7cd6 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.579881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d270c5-bedd-4d64-abeb-b3a9722b7cd6 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:49.590805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:49.591821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.592285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.592762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.607419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:49.615255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:49.616811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 350/683] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:49.622862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ee7f-43ae-4c03-8a05-c11c23d1db0d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.632728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ee7f-43ae-4c03-8a05-c11c23d1db0d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:49.642749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:49.643734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.644197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.644647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.645665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:49.646173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:49.647965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:49.663453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 334/684] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:49.668738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.682155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bbad3-fb79-4585-be48-ac24bf129335 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:49.689878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:49.690862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.691342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.691794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.713146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:49.715245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:49.743557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:49.745046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 351/685] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:49.750982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.771806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365776ef-87ce-4508-926d-b060b20d4164 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:49.776758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:49.777513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.777940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.778287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.779144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:49.779451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:49.781649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:49.802761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 335/686] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:49.807722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.826271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc8fb-cec2-45a7-8d50-d1f5a6debabd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:49.841935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63652-6703-4a66-b315-6ecd842f7e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:49.843024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63652-6703-4a66-b315-6ecd842f7e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.844023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63652-6703-4a66-b315-6ecd842f7e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.844495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63652-6703-4a66-b315-6ecd842f7e7f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.858495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63652-6703-4a66-b315-6ecd842f7e7f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:49.860879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63652-6703-4a66-b315-6ecd842f7e7f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:49.877788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-49a63652-6703-4a66-b315-6ecd842f7e7f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 03:59:49.879210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 352/687] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:49.884651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.902854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad573-1e76-4858-ae77-91bfb18f03a9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:49.905425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c83e7-25f8-45f3-a1db-fdcf3ee24f2d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.906469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c83e7-25f8-45f3-a1db-fdcf3ee24f2d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.906946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c83e7-25f8-45f3-a1db-fdcf3ee24f2d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.908294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:49.919267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.919387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 353/688] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:49.919463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.919463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.919463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:49.919463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:49.919463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:49.919756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6a47-e9a6-4b07-bdbe-6f807cf6bf43 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.919756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6a47-e9a6-4b07-bdbe-6f807cf6bf43 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.919756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e6a47-e9a6-4b07-bdbe-6f807cf6bf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.933344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 336/689] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:49.941324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.949903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8082347-a594-40fa-a8f8-1a56c34504a0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:49.950450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4e8e6a47-e9a6-4b07-bdbe-6f807cf6bf43 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:49.951785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4e8e6a47-e9a6-4b07-bdbe-6f807cf6bf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:49.955402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:49.956226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:49.956583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:49.957018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:49.965053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 354/690] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:49.966913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:49.969633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:49.979429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 337/691] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:49.984609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6a47-e9a6-4b07-bdbe-6f807cf6bf43 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.992198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:49.999043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e6a47-e9a6-4b07-bdbe-6f807cf6bf43 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.003457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522ec25-fc19-4395-9d2e-5ff0179ea661 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.008759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c64f5-5710-47e0-a121-2f2155cab92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.009783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c64f5-5710-47e0-a121-2f2155cab92d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.010327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c64f5-5710-47e0-a121-2f2155cab92d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.010797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c64f5-5710-47e0-a121-2f2155cab92d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.015387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.016183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.016470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.016746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.023705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c64f5-5710-47e0-a121-2f2155cab92d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.025879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c64f5-5710-47e0-a121-2f2155cab92d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.035393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.037448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.043519 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f36c64f5-5710-47e0-a121-2f2155cab92d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:50.045093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 338/692] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:50.046974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6995052-3644-43e7-85ec-fc25f0013def None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.047310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6995052-3644-43e7-85ec-fc25f0013def None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.047592 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6995052-3644-43e7-85ec-fc25f0013def None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.049566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 339/693] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:50.055110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47547078-5e47-4ad2-823c-ce1afa312487 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.055400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47547078-5e47-4ad2-823c-ce1afa312487 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.055688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47547078-5e47-4ad2-823c-ce1afa312487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.057815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:50.059570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 355/694] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:50.060592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.070703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577ce37-dbf6-4393-89fd-bb77b1de4276 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.074073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-47547078-5e47-4ad2-823c-ce1afa312487 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:50.075312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-47547078-5e47-4ad2-823c-ce1afa312487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:50.076067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.077050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.078112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.078533 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.079592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.080104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.082113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.084792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 340/695] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 03:59:50.094326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47547078-5e47-4ad2-823c-ce1afa312487 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.097136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 356/696] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.104742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47547078-5e47-4ad2-823c-ce1afa312487 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.111499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.118937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.119682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.120014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.120339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.121862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.122173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.124209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.125202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef13904-6a1c-46f4-ad48-6e3d21862a58 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.130658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.131537 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.132467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.132941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.134344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.136755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.137259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 341/697] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.138182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.150307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7586e1-afec-4c2c-b087-361d5efbe966 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.154842 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.155744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.162532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.162532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.162532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.162532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.170266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 12 03:59:50.172162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 342/698] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:50.177098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.185862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3807d26-788d-488f-8c04-ed3822736dd6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.190927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.191638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.191901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.192166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.199552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.201524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.215305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:50.216672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 343/699] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:50.221341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.230919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027cc70-dcae-47bf-ad93-e6cd39c9c1f4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.232062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 357/700] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 03:59:50 2022] POST /identity/v3/users => generated 254 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:50.233598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.236433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.237196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.237500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.237882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.238675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.242723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.242723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.246733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 344/701] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.252870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc67b6-d3f1-47af-bbf5-74ead6069de6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.253437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.258033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.258796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.259432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.259793 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.261316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.261729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.264082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.265311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd9d3a-d78f-431b-a758-0f32dce4c666 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.271161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293812a-cf79-439b-9e6e-9ff1eff06c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.272126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293812a-cf79-439b-9e6e-9ff1eff06c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.272622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293812a-cf79-439b-9e6e-9ff1eff06c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.273079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293812a-cf79-439b-9e6e-9ff1eff06c5c admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.274034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293812a-cf79-439b-9e6e-9ff1eff06c5c admin admin] RBAC: Adding query filter params (type=network) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.274717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293812a-cf79-439b-9e6e-9ff1eff06c5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.276698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293812a-cf79-439b-9e6e-9ff1eff06c5c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.280928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 358/702] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.289315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 345/703] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:50.290011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.298471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec952e-5236-467c-b6de-8e7d53dee725 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.303347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf681542-7cf6-4e23-8b00-915545d583f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.304173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681542-7cf6-4e23-8b00-915545d583f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.304556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681542-7cf6-4e23-8b00-915545d583f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.304927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf681542-7cf6-4e23-8b00-915545d583f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.305946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf681542-7cf6-4e23-8b00-915545d583f6 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=4509a13ccb074c5e9d8440755da77cc4) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.306357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf681542-7cf6-4e23-8b00-915545d583f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.308338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf681542-7cf6-4e23-8b00-915545d583f6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.315777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 359/704] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/role_assignments?user.id=4509a13ccb074c5e9d8440755da77cc4&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.377615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645b66-cf1e-449a-b9a9-d96ad7905eb7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.377800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645b66-cf1e-449a-b9a9-d96ad7905eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.378115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645b66-cf1e-449a-b9a9-d96ad7905eb7 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.380000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 346/705] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:50.386375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149939-7c34-4c5d-a62c-59f444062665 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.386676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149939-7c34-4c5d-a62c-59f444062665 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.386937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149939-7c34-4c5d-a62c-59f444062665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.411612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3d149939-7c34-4c5d-a62c-59f444062665 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:50.412852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3d149939-7c34-4c5d-a62c-59f444062665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:50.425439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 360/706] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:50.446205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645b66-cf1e-449a-b9a9-d96ad7905eb7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.464327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645b66-cf1e-449a-b9a9-d96ad7905eb7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.473336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.474146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.474423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.474694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.492590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:50.500350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:50.502608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 347/707] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:50.508207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149939-7c34-4c5d-a62c-59f444062665 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.522117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149939-7c34-4c5d-a62c-59f444062665 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.529991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.531230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.531502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.531809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.532610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.532987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.534675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.554546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 361/708] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.559879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.572156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeeaa1-7e8d-4400-84a3-df1952805b9a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.578390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.579191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.579468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.579748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.594747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.596626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.617065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:50.618620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 348/709] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:50.624257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.637843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f8d83-4508-4931-9795-7a5bd4b32771 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.642828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.643763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.644230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.644732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.645708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.646263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.648083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.662241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 362/710] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.668049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.686481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573609-0be4-450d-9a9b-2d3d7d2a9696 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.694127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.695256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.695741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.696252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.708997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.711680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.730143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 03:59:50.731668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 349/711] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:50.737439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.754804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb4195-6e69-48fd-a396-b110c0073350 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.769948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.770626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.770907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.771183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.772048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.772364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.774294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.797272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 363/712] 10.222.0.31 () {56 vars in 1156 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.802712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.816579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fcb85-a6a5-424e-8e40-3b27e2e79b6e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.825130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.826041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.826548 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.827047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.841244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.843383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.857205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 350/713] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 03:59:50.863566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.881384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170826f-8e81-460b-ad7f-3b43f2d25e8b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.887923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.888709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.888997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.889285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.909520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.911360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.939812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:50.945267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 364/714] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:50.946653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:50.960972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d99a-4bc0-4695-a33a-bd112fc8bf18 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:50.965640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:50.966283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:50.966567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:50.966846 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:50.967631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:50.967942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:50.978242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:50.994311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 351/715] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:50.999638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:51.014250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b8883-e33c-48d7-af2e-7920bf25e6f1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:51.019323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:51.020088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:51.020367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:51.020640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:51.027501 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:51.029480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:51.042711 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:51.043847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 365/716] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:51.049768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:51.063270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3015e-46c3-4bfc-ac92-6948a0142754 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:51.067967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16fad4-b680-4fa4-bcf4-40e3a3cebda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:51.068667 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fad4-b680-4fa4-bcf4-40e3a3cebda7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:51.068956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fad4-b680-4fa4-bcf4-40e3a3cebda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:51.069232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fad4-b680-4fa4-bcf4-40e3a3cebda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:51.070087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16fad4-b680-4fa4-bcf4-40e3a3cebda7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:51.070397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16fad4-b680-4fa4-bcf4-40e3a3cebda7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:51.072364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16fad4-b680-4fa4-bcf4-40e3a3cebda7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:51.099567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 352/717] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:51.105100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:51.122187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f431531-55e9-42bf-bb6f-c28fec48f02d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:51.133874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a0942-8f18-4064-8406-74eddc4155dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:51.134515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a0942-8f18-4064-8406-74eddc4155dc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:51.134800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a0942-8f18-4064-8406-74eddc4155dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:51.135082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a0942-8f18-4064-8406-74eddc4155dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:51.135931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a0942-8f18-4064-8406-74eddc4155dc admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=2f8eac55c400472296dfec3a113799d7) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:51.136247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a0942-8f18-4064-8406-74eddc4155dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:51.138154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a0942-8f18-4064-8406-74eddc4155dc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:51.144926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 366/718] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:51 2022] GET /identity/v3/role_assignments?user.id=2f8eac55c400472296dfec3a113799d7&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:51.814923 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63299-f510-4474-b825-90ee45177e0f None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:51.815979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63299-f510-4474-b825-90ee45177e0f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:51.816487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b63299-f510-4474-b825-90ee45177e0f None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:51.818883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 353/719] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:51.824884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a26f43-30e0-437e-b3cf-d0112e4df3c9 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:51.825840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a26f43-30e0-437e-b3cf-d0112e4df3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:51.826331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a26f43-30e0-437e-b3cf-d0112e4df3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:51.849458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b3a26f43-30e0-437e-b3cf-d0112e4df3c9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:51.850996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b3a26f43-30e0-437e-b3cf-d0112e4df3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:51.864415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 367/720] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 03:59:51.888596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b63299-f510-4474-b825-90ee45177e0f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:51.903127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b63299-f510-4474-b825-90ee45177e0f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:51.910413 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383c3c9-794f-42e8-bb1a-2fde59db25c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:51.911328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c3c9-794f-42e8-bb1a-2fde59db25c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:51.911766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c3c9-794f-42e8-bb1a-2fde59db25c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:51.920566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c3c9-794f-42e8-bb1a-2fde59db25c8 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:51.920566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383c3c9-794f-42e8-bb1a-2fde59db25c8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:51.920566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-d383c3c9-794f-42e8-bb1a-2fde59db25c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:51.920566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:51.920566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:51.920566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383c3c9-794f-42e8-bb1a-2fde59db25c8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:52.022135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 354/721] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 03:59:51 2022] POST /identity/v3/services => generated 251 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:52.717619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d81114-565c-4c78-afde-a7eed89c5bcd None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:52.718549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d81114-565c-4c78-afde-a7eed89c5bcd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:52.718723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d81114-565c-4c78-afde-a7eed89c5bcd None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:52.720741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 368/722] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:52.726554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dd2f-ac96-471c-8572-cc637b45c17f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:52.726837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dd2f-ac96-471c-8572-cc637b45c17f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:52.727112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1dd2f-ac96-471c-8572-cc637b45c17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:52.754569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1fc1dd2f-ac96-471c-8572-cc637b45c17f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:52.755925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1fc1dd2f-ac96-471c-8572-cc637b45c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:52.791346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 355/723] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:52 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:52.821904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d81114-565c-4c78-afde-a7eed89c5bcd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:52.839945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d81114-565c-4c78-afde-a7eed89c5bcd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:52.847374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53168fea-5803-4ee1-903f-7fc390512461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:52.848037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168fea-5803-4ee1-903f-7fc390512461 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:52.848316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168fea-5803-4ee1-903f-7fc390512461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:52.848591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168fea-5803-4ee1-903f-7fc390512461 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:52.849364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53168fea-5803-4ee1-903f-7fc390512461 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:52.850376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-53168fea-5803-4ee1-903f-7fc390512461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:52.850376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:52.850376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:52.851245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53168fea-5803-4ee1-903f-7fc390512461 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:52.947035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 369/724] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 03:59:52 2022] POST /identity/v3/services => generated 240 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:52.985186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b61435-e5c4-4869-ba38-8a59e764bd11 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:52.985712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b61435-e5c4-4869-ba38-8a59e764bd11 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:52.985712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b61435-e5c4-4869-ba38-8a59e764bd11 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:52.987940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 356/725] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:52.994071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e1c6-6a0d-47d9-8403-e1e2eaa4ecab None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:52.994392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e1c6-6a0d-47d9-8403-e1e2eaa4ecab None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:52.994618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e1c6-6a0d-47d9-8403-e1e2eaa4ecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.017343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3072e1c6-6a0d-47d9-8403-e1e2eaa4ecab None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:53.018553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3072e1c6-6a0d-47d9-8403-e1e2eaa4ecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:53.038104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 370/726] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:52 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:53.085316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b61435-e5c4-4869-ba38-8a59e764bd11 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.103113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b61435-e5c4-4869-ba38-8a59e764bd11 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.107568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.108349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.109159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.109538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.126315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:53.133093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:53.134595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 357/727] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:53.141038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e1c6-6a0d-47d9-8403-e1e2eaa4ecab None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.150034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e1c6-6a0d-47d9-8403-e1e2eaa4ecab None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.157623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe33a7-d1bb-48b3-a3aa-10ea282a7f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.158304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe33a7-d1bb-48b3-a3aa-10ea282a7f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.158585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe33a7-d1bb-48b3-a3aa-10ea282a7f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.158856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe33a7-d1bb-48b3-a3aa-10ea282a7f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.159689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe33a7-d1bb-48b3-a3aa-10ea282a7f40 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.160001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe33a7-d1bb-48b3-a3aa-10ea282a7f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.161617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe33a7-d1bb-48b3-a3aa-10ea282a7f40 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.173088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 371/728] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.179179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.194166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda0914-f9cf-46b3-9cdb-d49808c741b0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.198664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.199434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.199709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.199975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.215839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.218193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066980c-eb5b-430e-ab6c-f8068ec106de None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.218482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066980c-eb5b-430e-ab6c-f8068ec106de None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.218763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066980c-eb5b-430e-ab6c-f8068ec106de None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.220527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 372/729] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:53.221982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.227145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39bc7-8fed-4f79-b92f-c268e969fa3b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.227427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39bc7-8fed-4f79-b92f-c268e969fa3b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.227703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb39bc7-8fed-4f79-b92f-c268e969fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.241353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:53.242863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 358/730] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:53.248272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.258987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54ac0-5764-4b15-b18f-88250603e07f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.262297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ecb39bc7-8fed-4f79-b92f-c268e969fa3b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:53.263494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ecb39bc7-8fed-4f79-b92f-c268e969fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:53.263696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.264417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.264690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.265541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.266296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.266642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.268393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.287985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 359/731] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.297302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.299699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 373/732] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:53 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:53.303972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32ab14-8185-4a5f-a1e4-306d2cc900ad admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.308656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.309523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.309801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.310071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.326567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.329151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.333622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb39bc7-8fed-4f79-b92f-c268e969fa3b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.343133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb39bc7-8fed-4f79-b92f-c268e969fa3b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.347854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 03:59:53.348160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.353313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 360/733] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:53.353732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.354668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.355398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.355672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.370758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:53.371526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673dafa-4840-4261-851a-b5479e52ed65 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.376926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.377594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.377886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.378138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.378969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.379270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.380192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:53.381099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.382205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 374/734] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:53.387394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.398267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695d3be-ed49-4edd-b3b0-a13e98f098a8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.403421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.404332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.404813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.405310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.406704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.407210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.409068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.409963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 361/735] 10.222.0.31 () {56 vars in 1170 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.415629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.421659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 375/736] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.427048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.429514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce9113-f90f-4001-b1ac-1079e76a771b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.434392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.435262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.435441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.435832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.439636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7096b-bc1d-41cd-8e02-e84d831c1c18 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.444322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.445316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.445798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.445899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.446334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.448046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.458205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.460273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.465418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 362/737] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 03:59:53.467710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.477151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a41b7-719e-4052-b397-1b4057918d36 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.481188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:53.481913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.482881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.483235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 376/738] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:53.485377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.485377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.488698 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.496792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.499017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.499124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ead02-8723-4cf9-87b5-e5d7ecf38f79 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.504423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.505072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.505379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.505665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.506384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.506685 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.508278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.520473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 377/739] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.520950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:53.522438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 363/740] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:53.530357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.533658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.551161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d64f2-dc5e-4222-b4ff-95f1ef24d1fc admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.553599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6e14c-5bd3-4044-843a-8ca99e271f0c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.564250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.564646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.566075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.566669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.567143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.567625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.568141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.568607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.571510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.572034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.574134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.586463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.591540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.609264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 364/741] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.617108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 03:59:53.618761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.629512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902aed7-14d2-46c6-a1ea-b79d098a34e0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.631189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 378/742] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:53.636139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.642466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.643559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.644041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.644547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.654297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417ec6-1fd4-4559-befd-c1684d96ae6f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.664759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.667307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.668597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.669748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.670283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.671246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.672576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.674457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.679793 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.696886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:53.700008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 365/743] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:53.705939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.713745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 379/744] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.720422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.726173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467cc09-6c45-4f0e-93c8-06fa3dcc06b8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.737165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.738454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596305d-1ae8-4491-860a-d27d73541bc4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.739369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.740251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.741077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.743306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.744384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.749026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.749990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.750995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.752847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.753368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.774362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.774982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 366/745] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.777070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.779913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.795149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87b3ee-82bc-4084-9715-902bcbc84432 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.805708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.806679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.808602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.809080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.810190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=9729abb9423b49cea97da93095e90c1c) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.810731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.812952 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.816895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:53.818454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 380/746] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:53.820097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 367/747] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/role_assignments?user.id=9729abb9423b49cea97da93095e90c1c&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.829449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.852047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3ec35-a7a9-4e1c-a77d-5757508a4352 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.868625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.869334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.869623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.869906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.870658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.870977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.872590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.898848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 381/748] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:53.904371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.919768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0f86-169b-4826-b7f7-5e647e298244 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.929337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.930560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.931047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.931599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.940053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.942499 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:53.958244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:53.960239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 368/749] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:53.965885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:53.982643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b80bd-1605-4014-91d0-0f0e2b55e2f7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:53.990094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df177f-f913-4e16-82c8-af3198fe0ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:53.990753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df177f-f913-4e16-82c8-af3198fe0ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:53.991034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df177f-f913-4e16-82c8-af3198fe0ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:53.991307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df177f-f913-4e16-82c8-af3198fe0ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:53.992104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df177f-f913-4e16-82c8-af3198fe0ae3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:53.992417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df177f-f913-4e16-82c8-af3198fe0ae3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:53.994276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df177f-f913-4e16-82c8-af3198fe0ae3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.010281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 382/750] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:54.016500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.027245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc766f-cbfc-4eaa-b44e-986b0dfed11a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.033741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc560dd-e496-4e75-bb27-eb73f68e6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.034750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc560dd-e496-4e75-bb27-eb73f68e6c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.035123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc560dd-e496-4e75-bb27-eb73f68e6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.035474 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc560dd-e496-4e75-bb27-eb73f68e6c4a admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/4509a13ccb074c5e9d8440755da77cc4/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.038643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc560dd-e496-4e75-bb27-eb73f68e6c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=4509a13ccb074c5e9d8440755da77cc4, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.041558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc560dd-e496-4e75-bb27-eb73f68e6c4a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.132017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 369/751] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:54 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/4509a13ccb074c5e9d8440755da77cc4/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:54.304674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408cc2-0404-449b-8426-13f481a90a50 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.305341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408cc2-0404-449b-8426-13f481a90a50 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.305813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408cc2-0404-449b-8426-13f481a90a50 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.307864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 383/752] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:54.315101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebca7c-821d-452c-8f3e-10f548bbadd0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.315101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebca7c-821d-452c-8f3e-10f548bbadd0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.315101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebca7c-821d-452c-8f3e-10f548bbadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.339390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-0cebca7c-821d-452c-8f3e-10f548bbadd0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:54.340578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0cebca7c-821d-452c-8f3e-10f548bbadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:54.397160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 370/753] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:54 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:54.422998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408cc2-0404-449b-8426-13f481a90a50 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.443515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408cc2-0404-449b-8426-13f481a90a50 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.453376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.454331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.454777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.455187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.474174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:54.481031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:54.482742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 384/754] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:54.488305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebca7c-821d-452c-8f3e-10f548bbadd0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.503087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebca7c-821d-452c-8f3e-10f548bbadd0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.511659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.512361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.512643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.512916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.513763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:54.514067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.515785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.528800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 371/755] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:54.534320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.550699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee7d04-8894-43b7-ace5-2000c443cd55 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.560944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.562043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.562542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.563019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.581226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.583489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.607277 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:54.609476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 385/756] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:54.615194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.629765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b32b61-86c4-4abc-9aaa-73a461bc4f55 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.637856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.638571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.639155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.639155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.640511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:54.640823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.642508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.664485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 372/757] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:54.669697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.686327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062a4fe-eb00-4957-8df8-467442977d39 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.693255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.694077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.694358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.694729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.714838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.718810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.737829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 03:59:54.743285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 386/758] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:54.744507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.759467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ce39-ab7f-4fcd-acb3-9e7a25abb578 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.767824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.768518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.768800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.769074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.770098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:54.770444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.772468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.796814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 373/759] 10.222.0.31 () {56 vars in 1156 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:54.802256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.818372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62edd5-acb1-433a-b78b-30e405f3ad30 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.822833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.823473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.823753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.824026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.842337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.844194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.855533 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 387/760] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 03:59:54.861818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.874090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c811-6d4e-44a8-808d-d9c345f03835 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.881183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.882030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.882304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.882571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.898686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.900582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.923201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:54.924665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 374/761] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:54.930144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:54.942191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b0a1-39b0-4f56-9932-d631c9d2479b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:54.954754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:54.955403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:54.959656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:54.959656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:54.959656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:54.959656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:54.959656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:54.982789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 388/762] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:54.988198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.002823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015bc49-d026-4810-b5db-dfbd6f1a786a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.009741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d872771-1bde-48d2-b99f-a80f061c9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.010548 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d872771-1bde-48d2-b99f-a80f061c9640 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.010828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d872771-1bde-48d2-b99f-a80f061c9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.011140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d872771-1bde-48d2-b99f-a80f061c9640 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.026442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d872771-1bde-48d2-b99f-a80f061c9640 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.028443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d872771-1bde-48d2-b99f-a80f061c9640 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.045740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-0d872771-1bde-48d2-b99f-a80f061c9640 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:55.047354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 375/763] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:55.052938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.069317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2cfa-248d-462f-9805-8d7a398751ba None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.069317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2cfa-248d-462f-9805-8d7a398751ba None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.069738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af5542-65c4-4221-bc51-5a37fe61abd9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.069890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b2cfa-248d-462f-9805-8d7a398751ba None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.071177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 376/764] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 03:59:55.076265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.076958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.077240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.077601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.078438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:55.078743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.080670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.095939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b4fa-c4f5-4712-95a9-0442346ea9c0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.096220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b4fa-c4f5-4712-95a9-0442346ea9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.096484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b4fa-c4f5-4712-95a9-0442346ea9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.110640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 389/765] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:55.116583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.127022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4be602-7329-45fe-8ff2-72e1bd530794 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.131753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.132449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.132733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.133066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.133954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=2f8eac55c400472296dfec3a113799d7) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:55.134310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-84a3b4fa-c4f5-4712-95a9-0442346ea9c0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:55.134496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.135511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-84a3b4fa-c4f5-4712-95a9-0442346ea9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:55.136205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.146496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 377/766] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:55 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:55.152668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 390/767] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/role_assignments?user.id=2f8eac55c400472296dfec3a113799d7&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:55.169605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b4fa-c4f5-4712-95a9-0442346ea9c0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.179134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b4fa-c4f5-4712-95a9-0442346ea9c0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.195619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.196440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.196723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.196995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.197764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.199407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.224161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 12 03:59:55.225854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 378/768] 10.222.0.31 () {56 vars in 1150 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:55.231516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.248107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd242853-8846-48ee-ac82-a05426a83147 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.257454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.258187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.258479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.258763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.259606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:55.260211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.261671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.270746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 391/769] 10.222.0.31 () {56 vars in 1145 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:55.278517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.299740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604810b-823b-429b-9f71-0f756218cd54 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.304269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.304939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.305220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.305523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.306259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:55.306568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.308179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.322285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 379/770] 10.222.0.31 () {56 vars in 1145 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:55.327688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.341508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe9dd2-ed1f-479d-b5c8-1985acbfa39e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.348954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.349694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.349984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.350265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.351133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] RBAC: Adding query filter params (interface=public, service_id=128d32c5232f4de096686d383b7af016, region_id=RegionOne) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:55.351454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.352525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:55.352525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:55.352525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:55.353539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaddb4e-b2f5-4e1a-a349-43e22538859b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.368166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 392/771] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/endpoints?service_id=128d32c5232f4de096686d383b7af016&interface=public®ion_id=RegionOne => generated 194 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:55.373622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.390817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19309065-9b79-434f-a5ca-25e6907ddad6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.397233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1683be-71b9-47f7-a5a7-a650f0f57fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.397987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1683be-71b9-47f7-a5a7-a650f0f57fec admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.398271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1683be-71b9-47f7-a5a7-a650f0f57fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.398601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1683be-71b9-47f7-a5a7-a650f0f57fec admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.399302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1683be-71b9-47f7-a5a7-a650f0f57fec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.401138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1683be-71b9-47f7-a5a7-a650f0f57fec admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:55.407399 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 380/772] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/services => generated 772 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:55.897352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46437-5fb7-49e1-865b-f3a23cd42b3b None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.898031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46437-5fb7-49e1-865b-f3a23cd42b3b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.898031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d46437-5fb7-49e1-865b-f3a23cd42b3b None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.899579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 393/773] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:55.905147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d72f-6df0-4b92-9739-72cd00779e70 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.905990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d72f-6df0-4b92-9739-72cd00779e70 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.906277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d72f-6df0-4b92-9739-72cd00779e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.930305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1e28d72f-6df0-4b92-9739-72cd00779e70 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:55.931513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1e28d72f-6df0-4b92-9739-72cd00779e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:55.939804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 381/774] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:55 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:55.972423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46437-5fb7-49e1-865b-f3a23cd42b3b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:55.985245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d46437-5fb7-49e1-865b-f3a23cd42b3b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:55.989883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:55.990821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:55.991101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:55.991371 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:55.992032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:55.993032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:55.993032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:55.993032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:55.993999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.007906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 12 03:59:56.013382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 394/775] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:55 2022] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:56.015206 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28d72f-6df0-4b92-9739-72cd00779e70 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.024231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28d72f-6df0-4b92-9739-72cd00779e70 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.028857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.029523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.029809 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.030080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.030834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] RBAC: Adding query filter params (name=network) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.031137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.032731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.037848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 382/776] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.043364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.054234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecda6c-98b2-48f5-93c7-0fd620e23e45 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.058930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.059668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.059946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.060214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.060985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.061335 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.063038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.069750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 395/777] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.078929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.090047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b902b-e18d-4adb-a30e-b3db4a005ddb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.098277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.098971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.099251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.099603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.100470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] RBAC: Adding query filter params (interface=public, service_id=7be4bdb5bfed462f93332a654a9ab924, region_id=RegionOne) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.100777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.101878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:56.101878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:56.101878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:56.102805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef8ca0-cecc-4dbe-bd19-0207d89527eb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.113514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 383/778] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/endpoints?service_id=7be4bdb5bfed462f93332a654a9ab924&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.119134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.129320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f1736-e5c0-4db6-a319-08dbc4ff156d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.137558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f543d-cc73-46de-b7f4-28501377fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.138260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f543d-cc73-46de-b7f4-28501377fccb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.138540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f543d-cc73-46de-b7f4-28501377fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.138814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f543d-cc73-46de-b7f4-28501377fccb admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.139562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f543d-cc73-46de-b7f4-28501377fccb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.141757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f543d-cc73-46de-b7f4-28501377fccb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.147807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 396/779] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/services => generated 772 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.456977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507bd04-b1ca-4d19-ad83-a4c98f10748c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.457398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507bd04-b1ca-4d19-ad83-a4c98f10748c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.457572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507bd04-b1ca-4d19-ad83-a4c98f10748c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.459476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 384/780] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:56.464825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6eb8-330a-4965-8aba-327b63a39c7e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.465115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6eb8-330a-4965-8aba-327b63a39c7e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.465417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6eb8-330a-4965-8aba-327b63a39c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.486201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b6dc6eb8-330a-4965-8aba-327b63a39c7e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:56.487399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b6dc6eb8-330a-4965-8aba-327b63a39c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:56.498799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 397/781] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:56 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:56.522570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507bd04-b1ca-4d19-ad83-a4c98f10748c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.535389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507bd04-b1ca-4d19-ad83-a4c98f10748c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.540813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.541607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.541883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.542148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.557974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:56.565618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 03:59:56.567187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 385/782] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:56.572859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6eb8-330a-4965-8aba-327b63a39c7e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.582109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6eb8-330a-4965-8aba-327b63a39c7e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.593697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.594377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.594662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.594944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.595716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.596027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.597654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.610300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 398/783] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.615877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.627345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401870ea-260f-4de3-baaf-ad58ce8f4840 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.632489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.633369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.633662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.633939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.646603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.648543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.667332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:56.668827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 386/784] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:56.674472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.684357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd645475-a5f7-4986-b4a9-872ab418bbfc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.689584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.690278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.690565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.690845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.691639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.691964 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.693648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.706041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 399/785] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.711770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.722673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc98a4-f0a9-4873-895a-05e14b14adec admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.728275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.729112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.729429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.729709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.737795 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.739941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.755177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 03:59:56.756673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 387/786] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:56.762183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.772872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53fea-cf21-4be8-816c-9926dd050750 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.778070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.778732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.779064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.779345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.780253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.780600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.782567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.809043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 400/787] 10.222.0.31 () {56 vars in 1170 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.814404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.824733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942634c-2b2d-4557-9012-685974adae3e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.830093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.830862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.831195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.831477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.842822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.844795 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.863059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:56.864539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 388/788] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:56.869944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.879826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db383d-4d32-47d7-9d7e-b2e327faadc2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.884392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981bb60-c1f1-417b-bc48-8f59a8f10ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.885170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981bb60-c1f1-417b-bc48-8f59a8f10ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.885497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981bb60-c1f1-417b-bc48-8f59a8f10ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.885782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981bb60-c1f1-417b-bc48-8f59a8f10ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.886518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981bb60-c1f1-417b-bc48-8f59a8f10ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.886839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981bb60-c1f1-417b-bc48-8f59a8f10ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.888433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981bb60-c1f1-417b-bc48-8f59a8f10ea2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.901171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 401/789] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:56.906651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.916984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1183d6-2e41-47c9-9d3d-92d0fcf9e665 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.922615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0631952-af82-4147-a065-8d499230bb77 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.922815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1183d6-2e41-47c9-9d3d-92d0fcf9e665 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.922815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1183d6-2e41-47c9-9d3d-92d0fcf9e665 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.922815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 402/790] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:56.924494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.925350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.925638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.925813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed3995-8d53-4d69-9a19-5466a9961191 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.925974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.926121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed3995-8d53-4d69-9a19-5466a9961191 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.926269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed3995-8d53-4d69-9a19-5466a9961191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.933710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:56.935801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:56.962664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:56.963353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d1ed3995-8d53-4d69-9a19-5466a9961191 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:56.965503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d1ed3995-8d53-4d69-9a19-5466a9961191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:56.966962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 389/791] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:56.973253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:56.986655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 403/792] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:56 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 03:59:56.991043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7297ef2-5ce1-47cd-b6d5-e8ddeec8f678 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:56.995897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:56.996568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:56.996816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:56.997190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:56.998130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:56.998439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.000947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.013984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 390/793] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:57.019808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed3995-8d53-4d69-9a19-5466a9961191 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.030012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed3995-8d53-4d69-9a19-5466a9961191 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.032191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.042031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.043040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.043327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.043608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/9729abb9423b49cea97da93095e90c1c/roles/a24e0024c3264885b078b73325e5b2ed` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.049986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf5a97-5393-46cc-a2ec-7ded8dd6a064 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.054109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.055003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.055285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.055559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.066959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:57.070074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=9729abb9423b49cea97da93095e90c1c, role_id=a24e0024c3264885b078b73325e5b2ed)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.072950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.074044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:57.077823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 391/794] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:57.082008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.094309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c553ba-5203-4266-8ba2-d97139996db0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.099882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.100763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.101220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.101720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.102649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:57.103181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.105051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.114423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 392/795] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:57.121317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.132920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86e5dd-28f3-4bed-b036-653caa49d48f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.141874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.142925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.143523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.143948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.159838 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.162199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 404/796] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:57 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/9729abb9423b49cea97da93095e90c1c/roles/a24e0024c3264885b078b73325e5b2ed => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:57.164341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.191162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:57.197255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 393/797] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:57.203035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.322070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a399e1-71bf-4abd-92ae-6d4fa6018c1a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.331476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.331476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.331476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.331476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.332838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:57.332838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.334354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.355309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 405/798] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:57.365185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.383771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4492e4-4e1c-438e-af20-f1290bb68971 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.396899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.398091 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.398578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.399080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.413225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.415669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.431865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 03:59:57.433336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 394/799] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:57.441442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.455706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3418-aaad-4b6e-a248-d5176a5e744a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.462323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.462991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.463271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.463633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.464539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:57.464850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.466844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.490831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 406/800] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:57.496899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.507558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947961b0-153b-478e-959b-c2e984b89d35 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.515494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.516193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.516467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.516737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.534579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.536447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.547005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 395/801] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 03:59:57.556988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.569557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfd0ea-13ce-4065-91f5-1cd49886b301 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.577909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.579085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.579085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.579258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.590498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.592355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.611926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:57.613458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 407/802] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:57.618893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.637760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564d018-78a8-48b6-94b2-d6d5b45e9f01 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.654111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.655069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.655349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.655648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.656536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:57.656843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.658465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.676597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 396/803] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:57.684301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.695166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93138d6-cc87-486c-ac13-bcf19ae94ad5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.706425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.707309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.707309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.707309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.716156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.718300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.732350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:57.733413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 408/804] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:57.740349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.755094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b739-af0b-4f7d-84f1-8c1878e9d853 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.770034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaeeef0-4416-43de-b59e-30e88d5578eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.770704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaeeef0-4416-43de-b59e-30e88d5578eb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.770983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaeeef0-4416-43de-b59e-30e88d5578eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.771242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaeeef0-4416-43de-b59e-30e88d5578eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.772049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaeeef0-4416-43de-b59e-30e88d5578eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:57.772352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaeeef0-4416-43de-b59e-30e88d5578eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.774367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaeeef0-4416-43de-b59e-30e88d5578eb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.790486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 397/805] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:57.796590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:57.813580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16f20-c143-4b0c-9ce9-bf015f9ce0d0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:57.821001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7ab7-f9bf-4e75-8685-b1cd61e5bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:57.822582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7ab7-f9bf-4e75-8685-b1cd61e5bfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:57.822582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7ab7-f9bf-4e75-8685-b1cd61e5bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:57.822582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7ab7-f9bf-4e75-8685-b1cd61e5bfc1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:57.823171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee7ab7-f9bf-4e75-8685-b1cd61e5bfc1 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=4509a13ccb074c5e9d8440755da77cc4) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:57.823482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee7ab7-f9bf-4e75-8685-b1cd61e5bfc1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:57.826526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee7ab7-f9bf-4e75-8685-b1cd61e5bfc1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:57.839710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 409/806] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 03:59:57 2022] GET /identity/v3/role_assignments?user.id=4509a13ccb074c5e9d8440755da77cc4&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:58.125759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c2f1-2c08-4c28-8873-0832e1d32bc8 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.126537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c2f1-2c08-4c28-8873-0832e1d32bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.126537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c2f1-2c08-4c28-8873-0832e1d32bc8 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.128289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 398/807] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:58.135535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7daf0f-0c2d-42bb-bd03-e492b2dd58d2 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.135535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7daf0f-0c2d-42bb-bd03-e492b2dd58d2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.135535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7daf0f-0c2d-42bb-bd03-e492b2dd58d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.155186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4f7daf0f-0c2d-42bb-bd03-e492b2dd58d2 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:58.157248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4f7daf0f-0c2d-42bb-bd03-e492b2dd58d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:58.169596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 410/808] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:58 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:58.189786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c2f1-2c08-4c28-8873-0832e1d32bc8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.202434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c2f1-2c08-4c28-8873-0832e1d32bc8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.207892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.208908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.209433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.209931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.221473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 03:59:58.228644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 03:59:58.233033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 399/809] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:58.238794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7daf0f-0c2d-42bb-bd03-e492b2dd58d2 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.248928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7daf0f-0c2d-42bb-bd03-e492b2dd58d2 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.255045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.256138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.256668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.257143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.258206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:58.258740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.260632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.275864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 411/810] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:58.282444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.295932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c416d-a96a-45d1-877a-617fe6f15fed admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.300721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.301564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.301841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.302172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.316788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.318626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.341738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:58.342982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 400/811] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:58.349032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.363297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f08e-7b44-4b4d-80ac-76e981df9782 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.370744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.371739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.372233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.372775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.373761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:58.374395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.376316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.394167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 412/812] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:58.399843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.414714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a04cf-b610-4b78-97de-7347f07f6028 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.421524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.422587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.423082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.423576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.433362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.435684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.461267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 03:59:58.462866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 401/813] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:58.468584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.483102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711d725-bea5-4ee3-973e-bd5edfded1d5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.488639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd14c7-bbe1-4d35-b290-c909881cd698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.489629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd14c7-bbe1-4d35-b290-c909881cd698 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.490118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd14c7-bbe1-4d35-b290-c909881cd698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.490664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd14c7-bbe1-4d35-b290-c909881cd698 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.491789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd14c7-bbe1-4d35-b290-c909881cd698 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:58.492307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd14c7-bbe1-4d35-b290-c909881cd698 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.494436 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd14c7-bbe1-4d35-b290-c909881cd698 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.521779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 413/814] 10.222.0.31 () {56 vars in 1156 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:58.526828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.539065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5827a-6081-4c9a-a175-43b1f01517b5 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.540515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c0652-62f2-4c66-a037-5a1c44c543d1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.541707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5827a-6081-4c9a-a175-43b1f01517b5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.542004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5827a-6081-4c9a-a175-43b1f01517b5 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.544128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 414/815] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:58.546834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.547881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.548527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.549029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.550001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4148-184a-476d-a6a6-2b0997b918bd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.550354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4148-184a-476d-a6a6-2b0997b918bd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.550640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4148-184a-476d-a6a6-2b0997b918bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.562230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.564465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.582507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 03:59:58.584401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 402/816] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:58.586556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e17b4148-184a-476d-a6a6-2b0997b918bd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:58.587766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e17b4148-184a-476d-a6a6-2b0997b918bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:58.589767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.600641 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0487e-871f-41a3-bfea-1a7c02d9ec66 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.605866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.607018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.607519 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.607696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 415/817] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:58 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 03:59:58.608300 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.609935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:58.610497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.612507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.626586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 403/818] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:58.633317 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4148-184a-476d-a6a6-2b0997b918bd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.643776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.646299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4148-184a-476d-a6a6-2b0997b918bd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.654459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184d173-13f8-4cc1-9b60-3faad191daed admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.657673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.658565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.658843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.659117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.662843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.663939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.665472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.665968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.667390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.670193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.675510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.677924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.686436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 12 03:59:58.686436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 404/819] 10.222.0.31 () {56 vars in 1150 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 03:59:58.692412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.701918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e8f8a-d2c8-4b35-8472-977a0a1e8813 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.712110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.712781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.713059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.713348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.714057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:58.714251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 03:59:58.715505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 416/820] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:58.715820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.717526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.721562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.730892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 405/821] 10.222.0.31 () {56 vars in 1145 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:58.734465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef2198-da6f-45b7-b588-5a563c85aabe admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.740843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.748904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.750412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.750693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.750966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.754060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:58.754378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.756274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d10479-1796-4754-9246-c507ddd48633 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.757038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.764574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.765311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.765639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.765912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.766619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:58.769072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.772033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.779986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 406/822] 10.222.0.31 () {56 vars in 1145 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:58.782504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 417/823] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 03:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 03:59:58.785581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.790315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:58.801727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5f20-3d9d-4802-bdef-b54287e09801 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.806557 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d177b4-fa97-4bf0-838f-e022f92949bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.807243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d177b4-fa97-4bf0-838f-e022f92949bf admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.807521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d177b4-fa97-4bf0-838f-e022f92949bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.807791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d177b4-fa97-4bf0-838f-e022f92949bf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.808595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d177b4-fa97-4bf0-838f-e022f92949bf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.809671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-e7d177b4-fa97-4bf0-838f-e022f92949bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:58.809671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 03:59:58.809671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 03:59:58.810578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d177b4-fa97-4bf0-838f-e022f92949bf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.811402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8669b1e-b1e6-4b5d-b8cd-84a2e8fe7575 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:58.822826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f85a-ddb7-4cab-870d-cd4eb69a6c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:58.823704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f85a-ddb7-4cab-870d-cd4eb69a6c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:58.823990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f85a-ddb7-4cab-870d-cd4eb69a6c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:58.824266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f85a-ddb7-4cab-870d-cd4eb69a6c48 admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/2f8eac55c400472296dfec3a113799d7/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:58.830563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3f85a-ddb7-4cab-870d-cd4eb69a6c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=2f8eac55c400472296dfec3a113799d7, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:58.833187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3f85a-ddb7-4cab-870d-cd4eb69a6c48 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:58.928153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 407/824] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 03:59:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:58.994321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 418/825] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 03:59:58 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/2f8eac55c400472296dfec3a113799d7/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 03:59:59.218813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d241cc-4d01-49d8-af83-5f04749ec62a None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.219793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d241cc-4d01-49d8-af83-5f04749ec62a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.220283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d241cc-4d01-49d8-af83-5f04749ec62a None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.222592 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 408/826] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:59.227891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07dfc6-17d0-4249-b531-692eab860885 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.228730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07dfc6-17d0-4249-b531-692eab860885 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.229206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07dfc6-17d0-4249-b531-692eab860885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.250006 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4a07dfc6-17d0-4249-b531-692eab860885 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:59.251532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4a07dfc6-17d0-4249-b531-692eab860885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:59.343835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 419/827] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:59 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:59.383962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d241cc-4d01-49d8-af83-5f04749ec62a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:59.397573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d241cc-4d01-49d8-af83-5f04749ec62a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:59.404917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:59.406073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.406572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.407069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] PATH_INFO: `/v3/services/network` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.407931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:59.409778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:59.425614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 12 03:59:59.427109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 409/828] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 03:59:59 2022] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 03:59:59.433041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07dfc6-17d0-4249-b531-692eab860885 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:59.443397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07dfc6-17d0-4249-b531-692eab860885 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:59.452716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:59.453715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.454206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.454679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.455605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] RBAC: Adding query filter params (name=network) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:59.456123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:59.457978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:59.464296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 420/829] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 03:59:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:59.470078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:59.481418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ee015-1c0e-4c24-8225-9377a429e6fd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:59.488436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ebce2-28ee-44ec-9e33-9774242f84b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:59.489386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ebce2-28ee-44ec-9e33-9774242f84b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.489884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ebce2-28ee-44ec-9e33-9774242f84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.490364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ebce2-28ee-44ec-9e33-9774242f84b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.491291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ebce2-28ee-44ec-9e33-9774242f84b7 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 03:59:59.491967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ebce2-28ee-44ec-9e33-9774242f84b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:59.493869 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ebce2-28ee-44ec-9e33-9774242f84b7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:59.499555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 410/830] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 03:59:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 03:59:59.505140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:59.515308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719acca-ca38-46b9-8fb2-2514e06a9a0e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:59.525019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ef694-135c-4de8-931a-1870fe824dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:59.525978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ef694-135c-4de8-931a-1870fe824dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.526464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ef694-135c-4de8-931a-1870fe824dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.526935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ef694-135c-4de8-931a-1870fe824dc5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.527915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ef694-135c-4de8-931a-1870fe824dc5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 03:59:59.529116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-d68ef694-135c-4de8-931a-1870fe824dc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 03:59:59.529116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 03:59:59.529116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 03:59:59.530900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ef694-135c-4de8-931a-1870fe824dc5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 03:59:59.644223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 421/831] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 03:59:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 03:59:59.882500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e498e1c-a600-4d58-99d4-855d5fb7fc24 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.883214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e498e1c-a600-4d58-99d4-855d5fb7fc24 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.883717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e498e1c-a600-4d58-99d4-855d5fb7fc24 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.885788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 411/832] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 03:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 03:59:59.904146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39ece2-79b4-44d5-ac5b-d8a990dd0b01 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 03:59:59.904763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39ece2-79b4-44d5-ac5b-d8a990dd0b01 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 03:59:59.905233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39ece2-79b4-44d5-ac5b-d8a990dd0b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 03:59:59.925785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ab39ece2-79b4-44d5-ac5b-d8a990dd0b01 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 03:59:59.927418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ab39ece2-79b4-44d5-ac5b-d8a990dd0b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 03:59:59.951164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 422/833] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 03:59:59 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 03:59:59.976077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e498e1c-a600-4d58-99d4-855d5fb7fc24 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 03:59:59.992779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e498e1c-a600-4d58-99d4-855d5fb7fc24 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 03:59:59.997988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 03:59:59.999118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.000143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.001247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.013194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:00.020570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:00:00.022341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 412/834] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 03:59:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:00.028050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39ece2-79b4-44d5-ac5b-d8a990dd0b01 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.042539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39ece2-79b4-44d5-ac5b-d8a990dd0b01 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.048030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.048693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.048975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.049251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.050059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.050364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.051974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.061054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 423/835] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:00.066818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.076905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304749-7135-44f7-b0b7-0f423bf75a8d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.083554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.084530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.085033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.085465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.099566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.101678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.118948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:00.120618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 413/836] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:00.126922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.145989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b718c-e8ae-4838-a6c3-6e19157bf5d5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.153077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.153874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.154252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.154682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.155589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.155994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.157710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.173672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 424/837] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:00.178663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.189226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6aa2-46ab-44a1-ae7b-072d7a3bd2c1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.193901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.195023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.195451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.195869 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.204716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.207025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.221298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:00:00.223383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 414/838] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:00.229058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.238524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1ec9-3514-4dd6-97ec-dd1733569155 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.243141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.243788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.244071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.244345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.245194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.245534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.247379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.268075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 425/839] 10.222.0.31 () {56 vars in 1170 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:00.273294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.288807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a704fd-5064-4111-b214-bc26fde1f3b1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.293576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.294301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.294583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.294965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.304294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.306180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.317335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 415/840] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:00.322662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.343562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b1a2-6e00-4b72-b0c8-74d22adfa51e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.348552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.349705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.350193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.350668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.361771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.363882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.384915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:00.386850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 426/841] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:00.393079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.402395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9f04-92f5-431b-aa27-ce514139cda1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.407284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.408189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.408669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.409149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.410107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.410606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.412412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.425140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 416/842] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:00.431067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.442418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336acfe1-2719-48de-9817-c631cefe6a50 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.447453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.448518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.449090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.449586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.457875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.460161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.473692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:00.475345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 427/843] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:00.481102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.491272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122331a0-8088-44a6-9684-cb01f0d15f96 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.496208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1f67-816a-4dfd-97d5-e3c30e943528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.497169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1f67-816a-4dfd-97d5-e3c30e943528 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.497685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1f67-816a-4dfd-97d5-e3c30e943528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.498175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1f67-816a-4dfd-97d5-e3c30e943528 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.499769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1f67-816a-4dfd-97d5-e3c30e943528 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.500302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1f67-816a-4dfd-97d5-e3c30e943528 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.502462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1f67-816a-4dfd-97d5-e3c30e943528 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.516157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 417/844] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:00.522576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.649184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64821f3-cf4e-48ef-abdb-e60e399ef664 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.654217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153bb41-197f-4b29-abbe-d2c149986126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.655093 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153bb41-197f-4b29-abbe-d2c149986126 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.655649 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153bb41-197f-4b29-abbe-d2c149986126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.656119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153bb41-197f-4b29-abbe-d2c149986126 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.657149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153bb41-197f-4b29-abbe-d2c149986126 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=9729abb9423b49cea97da93095e90c1c) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.657709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153bb41-197f-4b29-abbe-d2c149986126 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.659823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153bb41-197f-4b29-abbe-d2c149986126 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.666151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 428/845] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/role_assignments?user.id=9729abb9423b49cea97da93095e90c1c&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:00.798333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6a10-35bb-48d4-8dd0-5fa227013d2c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.799024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6a10-35bb-48d4-8dd0-5fa227013d2c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.799547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6a10-35bb-48d4-8dd0-5fa227013d2c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.801983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 418/846] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:00.807439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05553e-825b-49d5-a36a-f7c6ad967fbf None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.807729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05553e-825b-49d5-a36a-f7c6ad967fbf None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.808009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05553e-825b-49d5-a36a-f7c6ad967fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.826745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3f05553e-825b-49d5-a36a-f7c6ad967fbf None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:00.828485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3f05553e-825b-49d5-a36a-f7c6ad967fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:00.836813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 429/847] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:00 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:00.859430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a6a10-35bb-48d4-8dd0-5fa227013d2c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.872223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a6a10-35bb-48d4-8dd0-5fa227013d2c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.877313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.878095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.878377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.878651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.879325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.880917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.892494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 12 04:00:00.894049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 419/848] 10.222.0.31 () {56 vars in 1153 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:00.900421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05553e-825b-49d5-a36a-f7c6ad967fbf None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.917484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05553e-825b-49d5-a36a-f7c6ad967fbf None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.917484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76e325-cbf9-447b-93f6-58c33f9d0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.917484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e325-cbf9-447b-93f6-58c33f9d0187 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.917484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e325-cbf9-447b-93f6-58c33f9d0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.917871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e325-cbf9-447b-93f6-58c33f9d0187 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.917871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76e325-cbf9-447b-93f6-58c33f9d0187 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.917871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76e325-cbf9-447b-93f6-58c33f9d0187 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.919411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76e325-cbf9-447b-93f6-58c33f9d0187 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.925191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 430/849] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:00.930813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:00.942483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2fa3-d101-4565-ad22-d3fa9917fd9b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:00.947422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432b280-1d20-451d-ac96-d33a979ab38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:00.948063 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b280-1d20-451d-ac96-d33a979ab38d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:00.948342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b280-1d20-451d-ac96-d33a979ab38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:00.951878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432b280-1d20-451d-ac96-d33a979ab38d admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:00.951878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432b280-1d20-451d-ac96-d33a979ab38d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:00.951878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432b280-1d20-451d-ac96-d33a979ab38d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:00.951878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432b280-1d20-451d-ac96-d33a979ab38d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:00.956870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 420/850] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:01.427641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455e9ad-d169-4152-aac8-27aa3385b836 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.428644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455e9ad-d169-4152-aac8-27aa3385b836 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.429125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455e9ad-d169-4152-aac8-27aa3385b836 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.431363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 431/851] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:01.436935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a331a-8abb-4e04-b915-f1284d5ebe2b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.437748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a331a-8abb-4e04-b915-f1284d5ebe2b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.438215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a331a-8abb-4e04-b915-f1284d5ebe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.456786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-261a331a-8abb-4e04-b915-f1284d5ebe2b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:01.458297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-261a331a-8abb-4e04-b915-f1284d5ebe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:01.466628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 421/852] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:01 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:01.490187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455e9ad-d169-4152-aac8-27aa3385b836 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.503332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455e9ad-d169-4152-aac8-27aa3385b836 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.507961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb1e4-1486-401d-afbb-51d41b01324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.508971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb1e4-1486-401d-afbb-51d41b01324a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.509484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb1e4-1486-401d-afbb-51d41b01324a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.509944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb1e4-1486-401d-afbb-51d41b01324a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.521059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbb1e4-1486-401d-afbb-51d41b01324a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:01.527997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-44bbb1e4-1486-401d-afbb-51d41b01324a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:00:01.529670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 432/853] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:01.535743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a331a-8abb-4e04-b915-f1284d5ebe2b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.545166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a331a-8abb-4e04-b915-f1284d5ebe2b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.551428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7444-df8c-446e-b3bb-46b07f522339 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.551642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.552133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7444-df8c-446e-b3bb-46b07f522339 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.552300 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.552552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.552829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.553169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc7444-df8c-446e-b3bb-46b07f522339 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.553685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:01.553989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.555650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.556043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 433/854] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:01.562202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb3b0d-9c4b-456a-bbcb-174db31f610b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.562496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb3b0d-9c4b-456a-bbcb-174db31f610b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.562773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb3b0d-9c4b-456a-bbcb-174db31f610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.565695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 422/855] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:01.571116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.582970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-fbcb3b0d-9c4b-456a-bbcb-174db31f610b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:01.583625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22367b-e459-4724-8092-a68b9c947edf admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.584346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-fbcb3b0d-9c4b-456a-bbcb-174db31f610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:01.588946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.590059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.590509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.590936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.593129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 434/856] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:01 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:01.602648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.604688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.615697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb3b0d-9c4b-456a-bbcb-174db31f610b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.623345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:01.624817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb3b0d-9c4b-456a-bbcb-174db31f610b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.625180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 423/857] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:01.630002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.634013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.635030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.635410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.635790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.636613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.638419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.641544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c4e45-295b-48d5-9b23-2929b58da85a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.651429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.652345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.652802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.653260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.654155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:01.654655 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.656489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.658948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 12 04:00:01.665643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 435/858] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:01.667129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.672597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 424/859] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:01.677723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.678497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed140bab-53a5-4575-930e-75fa6c65efd6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.684199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.685213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.685810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.686251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.687702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:01.688155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.688273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d1a0b-3cea-4466-a4d3-4b9938e63a73 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.690179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.692961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.693920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.694245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.694623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.696289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 436/860] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:01.702229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.705000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.707522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.712320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c820dc6-310d-4c79-81fd-0daa1b81cc3c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.716989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.718409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.718796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.719171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.719983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:01.720391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.722109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.726000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 04:00:01.727714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 425/861] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:01.729420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 437/862] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:01.732625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.743450 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1e89-151c-4b1a-a932-9c28f41c781e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.748831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.750342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.750787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.751295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.752374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:01.752852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.754972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.776106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 426/863] 10.222.0.31 () {56 vars in 1156 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:01.781971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.792827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6015b6e-f077-43b9-89ac-54f4cf650e95 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.798306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.799249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.799728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.800150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.809787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.812495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.823363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 438/864] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:01.830472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.841096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741b92-26ec-4604-8de2-600da856a592 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.846796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.847819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.848200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.848596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.860239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.862346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.880906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:01.882642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 427/865] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:01.888394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.897949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ace594-40e4-4280-abf6-4cca1e177540 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.902612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.903282 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.903565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.903841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.904586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:01.904891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.907081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.922046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 439/866] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:01.928146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.943431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849a28f-e033-4104-8951-5b887f588cb5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:01.948015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:01.950157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:01.950157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:01.950157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:01.957460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:01.959560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:01.973878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:01.978611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 428/867] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:01.981855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:01.995000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834072e-540e-4f58-94f1-b423cd70f946 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:02.003284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eb787-f111-49da-910f-302b2a3895eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:02.003943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb787-f111-49da-910f-302b2a3895eb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:02.004276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb787-f111-49da-910f-302b2a3895eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:02.004558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb787-f111-49da-910f-302b2a3895eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:02.005433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb787-f111-49da-910f-302b2a3895eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:02.005750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb787-f111-49da-910f-302b2a3895eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:02.007676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb787-f111-49da-910f-302b2a3895eb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:02.024855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 440/868] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:02.030413 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:02.052924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbccbd-6c05-473e-9586-86987fce9b92 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:02.061169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5e9b1-6179-424b-8e13-3412d9bb0bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:02.062456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e9b1-6179-424b-8e13-3412d9bb0bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:02.062828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e9b1-6179-424b-8e13-3412d9bb0bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:02.063108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5e9b1-6179-424b-8e13-3412d9bb0bd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:02.064015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e9b1-6179-424b-8e13-3412d9bb0bd1 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=2f8eac55c400472296dfec3a113799d7) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:02.064332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e9b1-6179-424b-8e13-3412d9bb0bd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:02.067839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5e9b1-6179-424b-8e13-3412d9bb0bd1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:02.078991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 429/869] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:02 2022] GET /identity/v3/role_assignments?user.id=2f8eac55c400472296dfec3a113799d7&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:03.123955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4afc-76a8-4bfd-9bcb-0dcf97a021d3 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.124503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4afc-76a8-4bfd-9bcb-0dcf97a021d3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.124610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4afc-76a8-4bfd-9bcb-0dcf97a021d3 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.126606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 441/870] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:03.133802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179704f-3f87-47ac-9142-33340350ad38 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.134213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179704f-3f87-47ac-9142-33340350ad38 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.134352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179704f-3f87-47ac-9142-33340350ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.155416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8179704f-3f87-47ac-9142-33340350ad38 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:03.157115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8179704f-3f87-47ac-9142-33340350ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:03.168015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 430/871] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:03 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:03.195786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4afc-76a8-4bfd-9bcb-0dcf97a021d3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.208697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4afc-76a8-4bfd-9bcb-0dcf97a021d3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.213300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.214096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.214377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.214648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.225401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:03.232596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:00:03.234084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 442/872] 10.222.0.31 () {56 vars in 1141 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:03.239514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179704f-3f87-47ac-9142-33340350ad38 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.248480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179704f-3f87-47ac-9142-33340350ad38 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.253536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.254191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.254468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.254741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.255494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:03.255794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.257473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.266675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 431/873] 10.222.0.31 () {56 vars in 1136 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:03.272189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.289440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20159bab-f8a6-4f40-a572-659bc2c1ea4c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.289440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.289440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.289440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.290113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.298859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.300680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.317805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:03.319309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 443/874] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:03.324840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.334895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dd52c-4ec7-4d49-940f-4bf231183f8b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.339648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa94d8b-ef76-4b23-943b-aa7539d63b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.340290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa94d8b-ef76-4b23-943b-aa7539d63b62 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.340567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa94d8b-ef76-4b23-943b-aa7539d63b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.340843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa94d8b-ef76-4b23-943b-aa7539d63b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.341620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa94d8b-ef76-4b23-943b-aa7539d63b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:03.341923 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa94d8b-ef76-4b23-943b-aa7539d63b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.344044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa94d8b-ef76-4b23-943b-aa7539d63b62 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.356262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 432/875] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:03.361754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.372752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb35ec-8106-4cdd-a721-86f4b219185f None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.373010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964609-a2ee-47a9-8922-b12b452b1a76 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.373200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb35ec-8106-4cdd-a721-86f4b219185f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.373382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb35ec-8106-4cdd-a721-86f4b219185f None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.375852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 433/876] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:03.381230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092584f-c7e4-4ce1-a0c5-41cd68ee19b7 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.381545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092584f-c7e4-4ce1-a0c5-41cd68ee19b7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.381824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092584f-c7e4-4ce1-a0c5-41cd68ee19b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.384532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.385347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.385634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.385903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.394970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.396991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.403526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-5092584f-c7e4-4ce1-a0c5-41cd68ee19b7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:03.404945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5092584f-c7e4-4ce1-a0c5-41cd68ee19b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:03.411565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:00:03.421315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 444/877] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:03.421465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 434/878] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:03 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:03.423536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.435667 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c1bde-6259-4ce9-95a8-fb88480a5e24 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.441465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092584f-c7e4-4ce1-a0c5-41cd68ee19b7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.442877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.443708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.444145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.444520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.445647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:03.446062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.448185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.453422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092584f-c7e4-4ce1-a0c5-41cd68ee19b7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.462775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.464212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.465867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.467020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.469327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.469521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 445/879] 10.222.0.31 () {56 vars in 1170 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:03.471676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.475301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.487681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1195-4470-4dca-93d9-3ccc6909322a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.492670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.493529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.493960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.494381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.502656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.504564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.513789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 446/880] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:03.519929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.529230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c32c-3be0-41ee-8dff-d977b8edd518 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.534627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.535618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.539541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.541622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.548753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 435/881] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:03 2022] POST /identity/v3/services => generated 269 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:00:03.559021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.561212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.581215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:03.583008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 447/882] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:03.589077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.611309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c418e-d342-48f5-b858-0fc12b8995ad admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.616395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.617222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.617653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.618024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.618932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:03.619406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.621194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.635334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 436/883] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:03.641083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.651331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db89106-9264-45b3-be5d-1acbddf98ade admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.656216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.657054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.657363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.657899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.665816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.667839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.682863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:03.684427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 448/884] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:03.690454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.700697 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4fdf-0a2f-4e54-8de8-c794c27736b5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.706141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c959774-b45e-443c-92d4-630f95ba8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.706860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959774-b45e-443c-92d4-630f95ba8f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.707136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959774-b45e-443c-92d4-630f95ba8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.707459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959774-b45e-443c-92d4-630f95ba8f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.708277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959774-b45e-443c-92d4-630f95ba8f3a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:03.708636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959774-b45e-443c-92d4-630f95ba8f3a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.710586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959774-b45e-443c-92d4-630f95ba8f3a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.725549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 437/885] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:03.731686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:03.742670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b9d40-c157-4b41-93bd-3e2e17c5d4db admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:03.747067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3b7da-d618-41cd-a2b9-86343fcbcb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:03.747693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3b7da-d618-41cd-a2b9-86343fcbcb93 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:03.747970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3b7da-d618-41cd-a2b9-86343fcbcb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:03.748242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3b7da-d618-41cd-a2b9-86343fcbcb93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:03.749072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3b7da-d618-41cd-a2b9-86343fcbcb93 admin admin] RBAC: Adding query filter params (role.id=abd007b93b0b4dd29ad18040a7ccbc54, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=9729abb9423b49cea97da93095e90c1c) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:03.749400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3b7da-d618-41cd-a2b9-86343fcbcb93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:03.751219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3b7da-d618-41cd-a2b9-86343fcbcb93 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:03.756986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 449/886] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:03 2022] GET /identity/v3/role_assignments?user.id=9729abb9423b49cea97da93095e90c1c&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=abd007b93b0b4dd29ad18040a7ccbc54 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:04.160977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bab33-399c-4d62-883a-92f005bfddc2 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.161700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bab33-399c-4d62-883a-92f005bfddc2 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.161700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bab33-399c-4d62-883a-92f005bfddc2 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.163520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 438/887] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:04.168941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eac1a-3396-45d2-ad93-fafc130a4eb9 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.169454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eac1a-3396-45d2-ad93-fafc130a4eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.169624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780eac1a-3396-45d2-ad93-fafc130a4eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.187561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-780eac1a-3396-45d2-ad93-fafc130a4eb9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:04.188745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-780eac1a-3396-45d2-ad93-fafc130a4eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:04.196651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 450/888] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:04 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:04.219799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bab33-399c-4d62-883a-92f005bfddc2 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:04.232045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bab33-399c-4d62-883a-92f005bfddc2 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:04.236479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e1572-3ec9-4428-9202-a79f8e824920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:04.237172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1572-3ec9-4428-9202-a79f8e824920 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.237480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1572-3ec9-4428-9202-a79f8e824920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.237753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1572-3ec9-4428-9202-a79f8e824920 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.238498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e1572-3ec9-4428-9202-a79f8e824920 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:04.240076 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e1572-3ec9-4428-9202-a79f8e824920 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:04.321070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 439/889] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:04 2022] POST /identity/v3/services => generated 251 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:04.567265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0070b-d2ff-4132-bdbd-880fceb3caec None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.567609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0070b-d2ff-4132-bdbd-880fceb3caec None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.567824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0070b-d2ff-4132-bdbd-880fceb3caec None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.569888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 451/890] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:04.575228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74eb3-7418-4a87-989b-9a7a5d91916c None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.575520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74eb3-7418-4a87-989b-9a7a5d91916c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.575801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74eb3-7418-4a87-989b-9a7a5d91916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.595251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c6f74eb3-7418-4a87-989b-9a7a5d91916c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:04.596775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c6f74eb3-7418-4a87-989b-9a7a5d91916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:04.614810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 440/891] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:04 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:04.636766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0070b-d2ff-4132-bdbd-880fceb3caec None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:04.649590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0070b-d2ff-4132-bdbd-880fceb3caec None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:04.653954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:04.654800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.655088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.655428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.656103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:04.657752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:04.669118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:00:04.670624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 452/892] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:04.676632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74eb3-7418-4a87-989b-9a7a5d91916c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:04.686047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74eb3-7418-4a87-989b-9a7a5d91916c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:04.691171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0433c98-363e-4970-83a2-8a1a74dd8ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:04.691824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0433c98-363e-4970-83a2-8a1a74dd8ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.692108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0433c98-363e-4970-83a2-8a1a74dd8ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.692390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0433c98-363e-4970-83a2-8a1a74dd8ed3 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.693109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0433c98-363e-4970-83a2-8a1a74dd8ed3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:04.693448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0433c98-363e-4970-83a2-8a1a74dd8ed3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:04.695062 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0433c98-363e-4970-83a2-8a1a74dd8ed3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:04.700122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 441/893] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:04.705663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:04.716012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2d9d-c5d0-400c-8367-1058c0b0a204 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:04.721485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af38b-a99e-42fb-8aa9-43f3e99e64cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:04.722393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af38b-a99e-42fb-8aa9-43f3e99e64cf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:04.722902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af38b-a99e-42fb-8aa9-43f3e99e64cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:04.723391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af38b-a99e-42fb-8aa9-43f3e99e64cf admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:04.724318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af38b-a99e-42fb-8aa9-43f3e99e64cf admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:04.724855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af38b-a99e-42fb-8aa9-43f3e99e64cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:04.726719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af38b-a99e-42fb-8aa9-43f3e99e64cf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:04.732067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 453/894] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:05.891742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c932a-c6ee-4f02-a6c2-7501e815991d None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:05.892775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c932a-c6ee-4f02-a6c2-7501e815991d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:05.893335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c932a-c6ee-4f02-a6c2-7501e815991d None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:05.895850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 442/895] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:05.902064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375574d-6e8a-4150-8f66-6a7c60f7e25c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:05.902996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375574d-6e8a-4150-8f66-6a7c60f7e25c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:05.903483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375574d-6e8a-4150-8f66-6a7c60f7e25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:05.922584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6375574d-6e8a-4150-8f66-6a7c60f7e25c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:05.924149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6375574d-6e8a-4150-8f66-6a7c60f7e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:05.937499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 454/896] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:05 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:05.956711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c932a-c6ee-4f02-a6c2-7501e815991d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:05.970411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c932a-c6ee-4f02-a6c2-7501e815991d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:05.974455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e57f-b793-4b49-b2e8-606b30cbe417 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:05.975053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e57f-b793-4b49-b2e8-606b30cbe417 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:05.975561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e57f-b793-4b49-b2e8-606b30cbe417 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:05.976235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:05.977028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:05.977316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:05.977587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:05.978247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:05.978975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 455/897] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:05.982492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:05.983932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82221-8dc8-42d7-9be7-e8287df5f997 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:05.984219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82221-8dc8-42d7-9be7-e8287df5f997 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:05.984497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82221-8dc8-42d7-9be7-e8287df5f997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:05.996867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 12 04:00:05.998632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 443/898] 10.222.0.31 () {56 vars in 1153 bytes} [Sat Feb 12 04:00:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:06.004735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.007946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-30e82221-8dc8-42d7-9be7-e8287df5f997 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:06.009351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-30e82221-8dc8-42d7-9be7-e8287df5f997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:06.015155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41f028-fec6-4f69-ad0a-ab8adc033b71 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.025322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 456/899] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:05 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:06.026389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.027223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.027660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.028080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.028944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.029420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.031218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.040316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 444/900] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:06.041472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e82221-8dc8-42d7-9be7-e8287df5f997 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.043321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.051942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e82221-8dc8-42d7-9be7-e8287df5f997 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.053500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caa063-d374-45cb-b7bb-4bcd0739df1c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.057599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.058169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.058802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.059081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.059354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.059559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.060044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.060144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.060342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.060799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.062009 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.069429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 445/901] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:06.072923 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.078500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:06.085175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40156f5-8346-405f-8c20-f4a834c0ef68 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.086568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:00:06.088555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 457/902] 10.222.0.31 () {56 vars in 1141 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:06.090711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.091576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.092063 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.092533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.093619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] RBAC: Adding query filter params (interface=public, service_id=aee06799488849f7bd9876a9513bf626, region_id=RegionOne) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.094144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.094244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.096230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.102706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 446/903] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/endpoints?service_id=aee06799488849f7bd9876a9513bf626&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:06.105379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6454632-783a-408c-b197-2d22c4ad612a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.108053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.111512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.112380 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.112838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.113266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.114262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.114727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.116507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.119421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29b78-af00-43d0-a146-900eaede0919 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.124814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.125608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.125990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.126368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.127162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.131897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.132116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 458/904] 10.222.0.31 () {56 vars in 1136 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:06.134263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.135109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 447/905] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:00:06.147885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e76a25-fec2-4001-a4fd-907f1298076f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.153213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.154430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.154961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.155482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.167573 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.169853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.189453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:06.196062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 459/906] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:06.197813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.208601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114e4b-45f6-4cf9-acd0-6da0e72e068e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.214139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.215096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.215630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.216086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.217074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.217601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.220062 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.238660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 448/907] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:06.240356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.251744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cf2a1-6ec8-4671-842e-adf8b41f4afa admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.256884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.258004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.258534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.258991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.271845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.274096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.301237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:00:06.302947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 460/908] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:06.308901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.320499 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8de47-ff5d-4e20-818f-8b583ed124a6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.325778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.326987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.327541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.328038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.329113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.329655 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.331736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.352082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 449/909] 10.222.0.31 () {56 vars in 1170 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:06.361376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.367554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb79f-2940-444c-877b-29db58c172d1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.372260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.373081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.373448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.373727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.384631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.386763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.408749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:06.413379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 461/910] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:06.415936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.426879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a14d9-d9a8-40f5-b764-101309300347 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.431786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.432435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.432762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.433044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.433869 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.434178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.435839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.451540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 450/911] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:06.457134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.468726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf90cc2-3f33-4783-9ce4-9702bec6bdb6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.473667 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.474500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.474778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.475056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.482519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.485594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.499140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:06.505054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 462/912] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:06.506408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.520455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b97af9-1c54-41dc-80ff-26eae308f561 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.524910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac1199-3f51-42af-85b3-cb45cd054e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.525864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac1199-3f51-42af-85b3-cb45cd054e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.526359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac1199-3f51-42af-85b3-cb45cd054e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.526845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac1199-3f51-42af-85b3-cb45cd054e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.527867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac1199-3f51-42af-85b3-cb45cd054e19 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.528389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac1199-3f51-42af-85b3-cb45cd054e19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.530677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac1199-3f51-42af-85b3-cb45cd054e19 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.545235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 451/913] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:06.554492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.571238 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b4d64-31ea-4671-8118-af9b4bda2b5a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.576374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.577365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.577706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.577983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/9729abb9423b49cea97da93095e90c1c/roles/abd007b93b0b4dd29ad18040a7ccbc54` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.581481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=9729abb9423b49cea97da93095e90c1c, role_id=abd007b93b0b4dd29ad18040a7ccbc54)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.586322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.590639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977b69-5383-47e9-a322-e882a38e62a4 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.590927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977b69-5383-47e9-a322-e882a38e62a4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.591207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977b69-5383-47e9-a322-e882a38e62a4 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.592999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 452/914] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:06.598231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff123132-5332-4824-a2a4-1f2c4acc6f3d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.598520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff123132-5332-4824-a2a4-1f2c4acc6f3d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.598853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff123132-5332-4824-a2a4-1f2c4acc6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.618749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-ff123132-5332-4824-a2a4-1f2c4acc6f3d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:06.619939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ff123132-5332-4824-a2a4-1f2c4acc6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:06.627891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 453/915] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:06 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:06.651074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff123132-5332-4824-a2a4-1f2c4acc6f3d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.660554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff123132-5332-4824-a2a4-1f2c4acc6f3d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.664891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.665724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.666011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.666285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.666950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.668527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.679187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 12 04:00:06.680493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 454/916] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:06.686196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.695556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4d30c-9cf7-442e-8161-d5d7db2bf869 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.699994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.700601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.700882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.701156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.701886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.702704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.704261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.712129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 463/917] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:00:06 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/9729abb9423b49cea97da93095e90c1c/roles/abd007b93b0b4dd29ad18040a7ccbc54 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:00:06.717652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 455/918] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:06.735159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.814755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2214f4-fc69-4789-8195-f563d04525fd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.820143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.821159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.821671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.822198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.823146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.823707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.825630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.832347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 464/919] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:06.842456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.852912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de262f1-e986-4a0b-8bb1-d796959c3aff admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.857881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e631-5984-444a-b372-5fef10e4b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.859115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e631-5984-444a-b372-5fef10e4b8ad admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.859397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e631-5984-444a-b372-5fef10e4b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.859672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e631-5984-444a-b372-5fef10e4b8ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.860543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704e631-5984-444a-b372-5fef10e4b8ad admin admin] RBAC: Adding query filter params (interface=public, service_id=f4acd1112b074dae97aa43cd4cb37130, region_id=RegionOne) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:06.860854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704e631-5984-444a-b372-5fef10e4b8ad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.862535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704e631-5984-444a-b372-5fef10e4b8ad admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.872982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 456/920] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/endpoints?service_id=f4acd1112b074dae97aa43cd4cb37130&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:06.874520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:06.885620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560a00-852c-4263-8b6f-746ca14cef49 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:06.891368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c977c3e-25d8-4275-8677-75883d3fb2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:06.892338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977c3e-25d8-4275-8677-75883d3fb2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:06.892829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977c3e-25d8-4275-8677-75883d3fb2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:06.893339 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977c3e-25d8-4275-8677-75883d3fb2b3 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:06.894250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c977c3e-25d8-4275-8677-75883d3fb2b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:06.896073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c977c3e-25d8-4275-8677-75883d3fb2b3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:06.906548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 465/921] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:00:06 2022] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:00:07.045031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807bab-10ee-4c84-bfa0-c1900593d95b None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:07.045551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807bab-10ee-4c84-bfa0-c1900593d95b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:07.045551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807bab-10ee-4c84-bfa0-c1900593d95b None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:07.047837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 457/922] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:07.053636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c306b-37bb-4cab-92b0-75606594434d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:07.054236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c306b-37bb-4cab-92b0-75606594434d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:07.054726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c306b-37bb-4cab-92b0-75606594434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:07.074500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e04c306b-37bb-4cab-92b0-75606594434d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:07.076071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e04c306b-37bb-4cab-92b0-75606594434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:07.084475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 466/923] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:07 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:07.109740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807bab-10ee-4c84-bfa0-c1900593d95b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:07.122561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807bab-10ee-4c84-bfa0-c1900593d95b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:07.127724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ccc54-c06f-4899-8ee0-d624c8a5be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:07.128613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ccc54-c06f-4899-8ee0-d624c8a5be92 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:07.129127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ccc54-c06f-4899-8ee0-d624c8a5be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:07.129627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ccc54-c06f-4899-8ee0-d624c8a5be92 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:07.130579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ccc54-c06f-4899-8ee0-d624c8a5be92 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:07.132378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ccc54-c06f-4899-8ee0-d624c8a5be92 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:07.234611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 458/924] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:07 2022] POST /identity/v3/services => generated 241 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:08.437078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37300c-8ff1-4c5a-a52f-a455056b1002 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:08.437600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37300c-8ff1-4c5a-a52f-a455056b1002 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:08.437673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37300c-8ff1-4c5a-a52f-a455056b1002 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:08.439677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 467/925] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:08.444878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf4268-6bd5-4bf7-b796-315f59619672 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:08.445378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf4268-6bd5-4bf7-b796-315f59619672 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:08.445487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf4268-6bd5-4bf7-b796-315f59619672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:08.468331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f4cf4268-6bd5-4bf7-b796-315f59619672 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:08.469555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f4cf4268-6bd5-4bf7-b796-315f59619672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:08.488706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 459/926] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:08 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:08.511871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37300c-8ff1-4c5a-a52f-a455056b1002 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:08.524381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37300c-8ff1-4c5a-a52f-a455056b1002 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:08.533609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:08.534586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:08.535092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:08.535516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:08.536331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:08.538246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:08.551556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 12 04:00:08.554413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 468/927] 10.222.0.31 () {56 vars in 1153 bytes} [Sat Feb 12 04:00:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:08.560050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf4268-6bd5-4bf7-b796-315f59619672 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:08.569876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf4268-6bd5-4bf7-b796-315f59619672 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:08.574438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:08.575098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:08.575381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:08.575660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:08.576378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:08.576685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:08.578370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:08.583489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 460/928] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:08.589099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:08.599547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f140f-879e-4555-9a58-c52998f4dfe9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:08.604503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33205-ae9c-420b-a9fe-3500022ed688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:08.605364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33205-ae9c-420b-a9fe-3500022ed688 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:08.605793 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33205-ae9c-420b-a9fe-3500022ed688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:08.606230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33205-ae9c-420b-a9fe-3500022ed688 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:08.607088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33205-ae9c-420b-a9fe-3500022ed688 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:08.607545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33205-ae9c-420b-a9fe-3500022ed688 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:08.609354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33205-ae9c-420b-a9fe-3500022ed688 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:08.614675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 469/929] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:08.620278 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:08.630871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67d351-6b18-4164-a447-06c1c35e50a0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:08.635751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee399d-ee1e-412f-9281-eeddb82ed668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:08.636578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee399d-ee1e-412f-9281-eeddb82ed668 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:08.637008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee399d-ee1e-412f-9281-eeddb82ed668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:08.637453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee399d-ee1e-412f-9281-eeddb82ed668 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:08.638372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee399d-ee1e-412f-9281-eeddb82ed668 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:08.640179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee399d-ee1e-412f-9281-eeddb82ed668 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:08.733125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 461/930] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 04:00:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:09.032567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8fb0a-f8bf-4fa5-95ff-457a8d784404 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.032947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8fb0a-f8bf-4fa5-95ff-457a8d784404 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.033170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8fb0a-f8bf-4fa5-95ff-457a8d784404 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.035200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 470/931] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:09.040932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904543b5-4b9d-4c2e-9b69-a650448efa5a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.041230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904543b5-4b9d-4c2e-9b69-a650448efa5a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.041542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904543b5-4b9d-4c2e-9b69-a650448efa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.060406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-904543b5-4b9d-4c2e-9b69-a650448efa5a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:09.061702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-904543b5-4b9d-4c2e-9b69-a650448efa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:09.080243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 462/932] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:09 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:09.104982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8fb0a-f8bf-4fa5-95ff-457a8d784404 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.118255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8fb0a-f8bf-4fa5-95ff-457a8d784404 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.123081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8e3f2-c415-4cba-839c-2f56fe79bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.124211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e3f2-c415-4cba-839c-2f56fe79bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.124720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e3f2-c415-4cba-839c-2f56fe79bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.125222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e3f2-c415-4cba-839c-2f56fe79bc84 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.136994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8e3f2-c415-4cba-839c-2f56fe79bc84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:09.145151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-e6b8e3f2-c415-4cba-839c-2f56fe79bc84 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:00:09.146873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 471/933] 10.222.0.31 () {56 vars in 1141 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:09.152849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904543b5-4b9d-4c2e-9b69-a650448efa5a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.162230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904543b5-4b9d-4c2e-9b69-a650448efa5a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.167068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.167959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.168448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.168934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.170028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.170541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.172496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.175659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12490fce-4b5a-4bb8-a50a-f27be873df83 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.175953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12490fce-4b5a-4bb8-a50a-f27be873df83 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.176231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12490fce-4b5a-4bb8-a50a-f27be873df83 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.178248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 472/934] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:09.186147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955728b-a844-42fd-b8a9-8b1238eb1289 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.187092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955728b-a844-42fd-b8a9-8b1238eb1289 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.187481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955728b-a844-42fd-b8a9-8b1238eb1289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.189094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 463/935] 10.222.0.31 () {56 vars in 1136 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.195202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.206764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66cb3-dadd-4186-986d-7ea94fa161a3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.210570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4955728b-a844-42fd-b8a9-8b1238eb1289 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:09.211615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.212390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.212674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.212952 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.213261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4955728b-a844-42fd-b8a9-8b1238eb1289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:09.222991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 473/936] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:09 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:09.230423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.232547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.248244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955728b-a844-42fd-b8a9-8b1238eb1289 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.251776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:09.253082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 464/937] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:09.258373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955728b-a844-42fd-b8a9-8b1238eb1289 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.259743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.263408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.264299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.264752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.265134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.266009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.267718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.269150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb3c1e-38e3-4a03-ab42-02a2012104fa admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.273821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.274428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.274707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.274976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.279536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 12 04:00:09.281713 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 474/938] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:09.285945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.286257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.287893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.289694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.300709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 465/939] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:09.302302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915090c6-3a86-48bb-9708-378819f4a783 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.306160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.308197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.309203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.309775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.310294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.311251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.312363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.314312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.316800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db6a1a-3d06-470f-b49a-9f11a009f1c4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.321351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 475/940] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.326217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.327112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.327426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.327703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.329308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.339652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.341622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8a98f-19f1-49c1-8b8e-7ffecf2665b5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.343973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.347240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.347871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.348206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.348487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.349318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.349609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.351299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.357330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 476/941] 10.222.0.31 () {56 vars in 1135 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.362422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.366213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:00:09.372154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 466/942] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:09.372785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc5694-a952-4c6b-aafe-c0d1184145e0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.373108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.378460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.379361 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.379825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.380294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.381221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.383050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.383936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde99d-3848-47e3-bfd9-3cb6bfb98154 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.388488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.389180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.389617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.389993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.390858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.391230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.393330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.411112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 467/943] 10.222.0.31 () {56 vars in 1170 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.416738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.426490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3a158-ade3-4a7e-981c-02489df68681 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.431212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.431905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.432259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.432601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.441574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.443389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.453187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 468/944] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:09.458526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.473320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 477/945] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 04:00:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:00:09.473866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e4b73-4da7-451f-ac8b-99bbef86512d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.489762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.490781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.491225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.491562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.504254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.506263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.525990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:09.527713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 469/946] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:09.533576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.544880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f913a1-5620-4bb8-abf9-f4fb064eda9b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.550182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c755a-d8b1-4807-85c5-982e4374d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.550954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c755a-d8b1-4807-85c5-982e4374d7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.551287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c755a-d8b1-4807-85c5-982e4374d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.551562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c755a-d8b1-4807-85c5-982e4374d7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.552354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c755a-d8b1-4807-85c5-982e4374d7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.552711 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c755a-d8b1-4807-85c5-982e4374d7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.554419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c755a-d8b1-4807-85c5-982e4374d7c9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.570954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 478/947] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.579061 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.589936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97fb6-9e2e-459a-8308-be8925ac1900 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.593168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1a145-040b-487e-b7a5-21275777df49 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.593491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1a145-040b-487e-b7a5-21275777df49 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.593778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1a145-040b-487e-b7a5-21275777df49 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.595041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.595942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.596230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.596507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.596960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 479/948] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:09.601397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404994b-016b-43db-ac65-baac35cefd14 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.601691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404994b-016b-43db-ac65-baac35cefd14 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.601972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404994b-016b-43db-ac65-baac35cefd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.604957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.607267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.621597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2404994b-016b-43db-ac65-baac35cefd14 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:09.621837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:09.622872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2404994b-016b-43db-ac65-baac35cefd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:09.623356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 470/949] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:09.629773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.641396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 480/950] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:09 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:09.648269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce8495-7f0d-49e7-9f61-423227c6edb6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.653303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.654264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.654541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.654814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.655724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.656034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.659029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.661728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404994b-016b-43db-ac65-baac35cefd14 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.671351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404994b-016b-43db-ac65-baac35cefd14 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.672181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 471/951] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.676030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.676973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.677259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.677570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.678036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.678245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.679935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.688617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180426b1-fe38-47f8-beb2-7085cfa351c7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.692273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:00:09.693723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 481/952] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:09.694405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.695049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.695326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.695605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.696448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] RBAC: Adding query filter params (role.id=abd007b93b0b4dd29ad18040a7ccbc54, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=9729abb9423b49cea97da93095e90c1c) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.696757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.698753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.701003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.705103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 472/953] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/role_assignments?user.id=9729abb9423b49cea97da93095e90c1c&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=abd007b93b0b4dd29ad18040a7ccbc54 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.710889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c438f-0456-46d0-bb05-402f750336a7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.715866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.716554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.716823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.717106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.717917 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.718225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.719883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.725915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 482/954] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:09.731751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.743650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf941f64-d362-489d-9d37-3f063db13233 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.748504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.749758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.750043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.750318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.751059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.751365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.752979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.758731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 473/955] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:09.764788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.775661 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6611c21-fad4-4033-83b5-7bcc19315353 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.780459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5fba6-3d02-4544-ba97-67c41f49042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.781137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5fba6-3d02-4544-ba97-67c41f49042e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.781518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5fba6-3d02-4544-ba97-67c41f49042e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.781801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5fba6-3d02-4544-ba97-67c41f49042e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.782688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5fba6-3d02-4544-ba97-67c41f49042e admin admin] RBAC: Adding query filter params (interface=public, service_id=ef3d9760bfa745b28a41cec95d48c2b1, region_id=RegionOne) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:09.783007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5fba6-3d02-4544-ba97-67c41f49042e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.784708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5fba6-3d02-4544-ba97-67c41f49042e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.790681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 483/956] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/endpoints?service_id=ef3d9760bfa745b28a41cec95d48c2b1&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:09.797489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:09.807313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a3d86-21de-42ff-a6c4-06daa7fd1d1b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:09.813181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d2e72-e634-4056-92f4-539123d3b3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:09.814184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e72-e634-4056-92f4-539123d3b3ec admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:09.814625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e72-e634-4056-92f4-539123d3b3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:09.815054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d2e72-e634-4056-92f4-539123d3b3ec admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:09.815927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d2e72-e634-4056-92f4-539123d3b3ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:09.817792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d2e72-e634-4056-92f4-539123d3b3ec admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:09.825101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 474/957] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:00:09 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:00:11.022142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd6659-0acc-4d79-bc72-d894977ebd54 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.022689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd6659-0acc-4d79-bc72-d894977ebd54 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.022689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd6659-0acc-4d79-bc72-d894977ebd54 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.024714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 484/958] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:11.029891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92d6f-b636-4ba6-9099-9a0b6fea9977 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.030336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92d6f-b636-4ba6-9099-9a0b6fea9977 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.030512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92d6f-b636-4ba6-9099-9a0b6fea9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.048507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-4cf92d6f-b636-4ba6-9099-9a0b6fea9977 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:11.049719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4cf92d6f-b636-4ba6-9099-9a0b6fea9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:11.057677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 475/959] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:11 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:11.079791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd6659-0acc-4d79-bc72-d894977ebd54 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:11.092258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd6659-0acc-4d79-bc72-d894977ebd54 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:11.096727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:11.097521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.097806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.098076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.098742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:11.100319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:11.111519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 12 04:00:11.112929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 485/960] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:11.118748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf92d6f-b636-4ba6-9099-9a0b6fea9977 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:11.127722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf92d6f-b636-4ba6-9099-9a0b6fea9977 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:11.132299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1ea2-d974-4c34-a7b2-03ec2ba209d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:11.132941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1ea2-d974-4c34-a7b2-03ec2ba209d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.133298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1ea2-d974-4c34-a7b2-03ec2ba209d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.133572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1ea2-d974-4c34-a7b2-03ec2ba209d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.134290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1ea2-d974-4c34-a7b2-03ec2ba209d3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:11.134590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1ea2-d974-4c34-a7b2-03ec2ba209d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:11.136167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1ea2-d974-4c34-a7b2-03ec2ba209d3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:11.141640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 476/961] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 04:00:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:11.146979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:11.158262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805557c0-3d17-44b5-952a-bdf0b9794352 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:11.162906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb905f-c8df-45fa-8894-67bfefcbae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:11.163573 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb905f-c8df-45fa-8894-67bfefcbae52 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.163868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb905f-c8df-45fa-8894-67bfefcbae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.164144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb905f-c8df-45fa-8894-67bfefcbae52 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.164902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb905f-c8df-45fa-8894-67bfefcbae52 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:11.165207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb905f-c8df-45fa-8894-67bfefcbae52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:11.166798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb905f-c8df-45fa-8894-67bfefcbae52 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:11.171973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 486/962] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 04:00:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:11.792450 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08d606-be66-43a4-8e6d-d009456933c3 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.792745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08d606-be66-43a4-8e6d-d009456933c3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.793271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08d606-be66-43a4-8e6d-d009456933c3 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.795041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 477/963] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:11.801014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0661b-0004-4ddc-b5f7-2425e8bea50a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.801334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0661b-0004-4ddc-b5f7-2425e8bea50a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.801613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0661b-0004-4ddc-b5f7-2425e8bea50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.819936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-90f0661b-0004-4ddc-b5f7-2425e8bea50a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:11.821167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-90f0661b-0004-4ddc-b5f7-2425e8bea50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:11.833434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 487/964] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:11 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:11.854249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08d606-be66-43a4-8e6d-d009456933c3 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:11.867371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08d606-be66-43a4-8e6d-d009456933c3 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:11.871866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:11.872514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.872796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.873072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:11.873852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:11.875738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:11.877092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.common [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 12 04:00:11.965989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.sql.core [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 12 04:00:11.965989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 12 04:00:11.965989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [parameters: {'id': '8329e55eef52445e8745300ecf3b9f19', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 12 04:00:11.965989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79509) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 12 04:00:11.973356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-5a136188-4acc-443c-b18f-93748b10eb02 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8329e55eef52445e8745300ecf3b9f19.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8329e55eef52445e8745300ecf3b9f19. Feb 12 04:00:11.976202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 478/965] 10.222.0.31 () {60 vars in 1161 bytes} [Sat Feb 12 04:00:11 2022] POST /identity/v3/projects => generated 262 bytes in 121 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:11.980782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0661b-0004-4ddc-b5f7-2425e8bea50a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:11.990633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0661b-0004-4ddc-b5f7-2425e8bea50a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:11.995425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02b61-1713-4171-8b3b-7700b372d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:11.996260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02b61-1713-4171-8b3b-7700b372d362 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:11.996588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02b61-1713-4171-8b3b-7700b372d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:11.996916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02b61-1713-4171-8b3b-7700b372d362 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.004850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a02b61-1713-4171-8b3b-7700b372d362 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.006828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a02b61-1713-4171-8b3b-7700b372d362 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.017947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402897-ca49-40d0-8466-34b1e2ef48b9 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.018366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402897-ca49-40d0-8466-34b1e2ef48b9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.018705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96402897-ca49-40d0-8466-34b1e2ef48b9 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.020517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-44a02b61-1713-4171-8b3b-7700b372d362 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:12.023811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 479/967] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:12.024974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 488/967] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:12.027945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96402897-ca49-40d0-8466-34b1e2ef48b9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.029065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679cdc7-bc23-4c14-9aea-13e5f992c10a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.029461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679cdc7-bc23-4c14-9aea-13e5f992c10a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.029814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679cdc7-bc23-4c14-9aea-13e5f992c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.044834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96402897-ca49-40d0-8466-34b1e2ef48b9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.050408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4679cdc7-bc23-4c14-9aea-13e5f992c10a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:12.056870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.056870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.056870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.057327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4679cdc7-bc23-4c14-9aea-13e5f992c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:12.057490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.057490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:12.057490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.057490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.060303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 489/968] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:12 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:12.076374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 480/969] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 04:00:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:12.085844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679cdc7-bc23-4c14-9aea-13e5f992c10a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.095902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679cdc7-bc23-4c14-9aea-13e5f992c10a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.101215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b00655-aa73-4444-8379-ec21217b23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.102162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00655-aa73-4444-8379-ec21217b23b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.102515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00655-aa73-4444-8379-ec21217b23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.102987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b00655-aa73-4444-8379-ec21217b23b6 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.103765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b00655-aa73-4444-8379-ec21217b23b6 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.105566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b00655-aa73-4444-8379-ec21217b23b6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.118484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-29b00655-aa73-4444-8379-ec21217b23b6 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 12 04:00:12.120116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 490/970] 10.222.0.31 () {56 vars in 1126 bytes} [Sat Feb 12 04:00:12 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:12.125979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.129189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e00b-a606-4f31-874c-a1ec84ccc82d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.129504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e00b-a606-4f31-874c-a1ec84ccc82d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.129850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617e00b-a606-4f31-874c-a1ec84ccc82d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.131884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 491/971] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:12.140293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268edf1-e69e-4259-977e-4a50897acd69 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.140293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268edf1-e69e-4259-977e-4a50897acd69 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.140293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268edf1-e69e-4259-977e-4a50897acd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.140659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402ed30-6f0e-43f1-b9b2-c2a2b714472d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.144121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.144924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.145448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.145833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.146664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] RBAC: Adding query filter params (name=image) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:12.147251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.149244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.154658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 481/972] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:12.160713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.161602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-8268edf1-e69e-4259-977e-4a50897acd69 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:12.163029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8268edf1-e69e-4259-977e-4a50897acd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:12.177377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2229bfc-33d9-4fef-b1c8-a66d802cc52a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.177377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.177377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.177377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.177920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 492/973] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:12 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:12.178021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.178852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:12.179280 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.181003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.187306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 482/974] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:12.197548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268edf1-e69e-4259-977e-4a50897acd69 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.208553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268edf1-e69e-4259-977e-4a50897acd69 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.214062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.215177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.215647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.216072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.216930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.218916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.231815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:00:12.233782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 493/975] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:12.240208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.252393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d820fa-6079-44a9-abc0-ddd0f5f41d25 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.257933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.258975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.259513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.259957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.260915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:12.261431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.263295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.275378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.289642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 483/976] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:12.298183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3771d-a665-4cc6-b17a-6fb02dac65b8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.302995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fb232-e43a-47dd-bd87-534cc8dcc029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.303684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb232-e43a-47dd-bd87-534cc8dcc029 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.303966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb232-e43a-47dd-bd87-534cc8dcc029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.304238 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb232-e43a-47dd-bd87-534cc8dcc029 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.304988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb232-e43a-47dd-bd87-534cc8dcc029 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:12.305423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb232-e43a-47dd-bd87-534cc8dcc029 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.307021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb232-e43a-47dd-bd87-534cc8dcc029 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.313836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 494/977] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:12.319823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:12.330832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c6bc5-e454-428d-b8ae-c2823b1d5955 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:12.335643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba4c3-e9d3-4407-a658-59b2ef82cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:12.336571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba4c3-e9d3-4407-a658-59b2ef82cbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:12.336853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba4c3-e9d3-4407-a658-59b2ef82cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:12.337134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba4c3-e9d3-4407-a658-59b2ef82cbb5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:12.338028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba4c3-e9d3-4407-a658-59b2ef82cbb5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:12.339653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba4c3-e9d3-4407-a658-59b2ef82cbb5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:12.401755 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 484/978] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 04:00:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:13.413180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1c7c1-8710-43bb-a40a-a787580a42bb None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:13.413740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1c7c1-8710-43bb-a40a-a787580a42bb None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:13.413740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1c7c1-8710-43bb-a40a-a787580a42bb None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:13.415521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 495/979] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:13.421513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093989f2-0730-46c7-83dc-9c554618ef26 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:13.421921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093989f2-0730-46c7-83dc-9c554618ef26 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:13.421994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093989f2-0730-46c7-83dc-9c554618ef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:13.440338 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-093989f2-0730-46c7-83dc-9c554618ef26 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:13.441886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-093989f2-0730-46c7-83dc-9c554618ef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:13.459248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 485/980] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:13 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:13.482638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1c7c1-8710-43bb-a40a-a787580a42bb None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:13.497155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1c7c1-8710-43bb-a40a-a787580a42bb None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:13.502406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffe161-d9e7-47fa-82dd-3c456c5a1254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:13.503276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe161-d9e7-47fa-82dd-3c456c5a1254 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:13.503779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe161-d9e7-47fa-82dd-3c456c5a1254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:13.504253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe161-d9e7-47fa-82dd-3c456c5a1254 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:13.505189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffe161-d9e7-47fa-82dd-3c456c5a1254 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:13.507011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffe161-d9e7-47fa-82dd-3c456c5a1254 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:13.613688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 496/981] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:13 2022] POST /identity/v3/services => generated 242 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:00:14.463881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001445c-6666-484e-9b98-01c9c48a3553 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.464391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001445c-6666-484e-9b98-01c9c48a3553 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.464466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001445c-6666-484e-9b98-01c9c48a3553 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.465210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a6ba1-5d41-4136-90f9-fcc5af1fe9f1 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.465710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a6ba1-5d41-4136-90f9-fcc5af1fe9f1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.465789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a6ba1-5d41-4136-90f9-fcc5af1fe9f1 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.466500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 486/982] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:14.468090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 497/983] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:14.473639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f31ae-f51a-47d2-ad17-e9ddcb545aec None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.473928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f31ae-f51a-47d2-ad17-e9ddcb545aec None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.474211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f31ae-f51a-47d2-ad17-e9ddcb545aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.474409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c260-4a4d-4d8a-aefd-8c6be8cbb558 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.474887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c260-4a4d-4d8a-aefd-8c6be8cbb558 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.475361 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38c260-4a4d-4d8a-aefd-8c6be8cbb558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.494100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9f38c260-4a4d-4d8a-aefd-8c6be8cbb558 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:14.494316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-794f31ae-f51a-47d2-ad17-e9ddcb545aec None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:14.495433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-794f31ae-f51a-47d2-ad17-e9ddcb545aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:14.495935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9f38c260-4a4d-4d8a-aefd-8c6be8cbb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:14.521823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 487/984] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:14 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:14.522379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 498/985] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:14 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:14.538532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f31ae-f51a-47d2-ad17-e9ddcb545aec None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.548961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f31ae-f51a-47d2-ad17-e9ddcb545aec None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.549366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c260-4a4d-4d8a-aefd-8c6be8cbb558 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.554386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f81329-61e5-4768-8040-df008cb521cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.555277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81329-61e5-4768-8040-df008cb521cf admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.555759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81329-61e5-4768-8040-df008cb521cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.556240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f81329-61e5-4768-8040-df008cb521cf admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.557218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f81329-61e5-4768-8040-df008cb521cf admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.559025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f81329-61e5-4768-8040-df008cb521cf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.559509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38c260-4a4d-4d8a-aefd-8c6be8cbb558 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.565516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.566321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.566619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.566935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.567614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.569627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.570935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.common [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 12 04:00:14.632026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.sql.core [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 12 04:00:14.632026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 12 04:00:14.632026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [parameters: {'user_id': 'ae283d4f48a145ca82e3042ee9c153cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 12 04:00:14.632026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79510) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 12 04:00:14.640329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 488/986] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:14 2022] POST /identity/v3/services => generated 242 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:14.643865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d5d09-2a37-4821-b909-0964ed9dca33 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.644543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d5d09-2a37-4821-b909-0964ed9dca33 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.645009 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d5d09-2a37-4821-b909-0964ed9dca33 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.647669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 489/987] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:14.652779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 12 04:00:14.652779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 499/988] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:00:14 2022] POST /identity/v3/users => generated 160 bytes in 104 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:14.659777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f75c9-ea00-46d7-aee2-7738eefc2d64 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.659777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f75c9-ea00-46d7-aee2-7738eefc2d64 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.659777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f75c9-ea00-46d7-aee2-7738eefc2d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.660136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.670827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095846fe-dffa-4352-aec7-acc59fa723f1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.678153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-ef7f75c9-ea00-46d7-aee2-7738eefc2d64 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:14.679488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ef7f75c9-ea00-46d7-aee2-7738eefc2d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:14.693294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.694116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.694402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.694680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.705701 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 490/989] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:14 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:14.708858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.711474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.726527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 04:00:14.728259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f75c9-ea00-46d7-aee2-7738eefc2d64 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.730443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 500/990] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:14.738633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f75c9-ea00-46d7-aee2-7738eefc2d64 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.739054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.743775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.744604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.744887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.745164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.745925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.747622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.753616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487f154-8e57-4941-aa0b-58329769d9ad admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.759086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.760067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:00:14.760435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.760990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.766374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 491/991] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:14.766540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.766540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:14.767025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.768237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.768951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.784333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cccefa-bb39-47b7-bc14-ac0493f2cd46 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.790286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.791268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.791761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.792249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.793239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:14.793807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.797152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.808399 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 492/992] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:14.810407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.813012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 501/993] 10.222.0.31 () {56 vars in 1122 bytes} [Sat Feb 12 04:00:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:14.823224 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568aff-dfdf-47f9-b600-9aa7c92c3a1e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.833609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.833609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.834050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.834212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.834958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:14.835482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.837184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.846039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 493/994] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:14.852626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.864624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6189e2-9bcd-4954-beec-308f57fd4d95 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.870811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7698173-57ef-459c-8ac2-35142bc1c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.871972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7698173-57ef-459c-8ac2-35142bc1c18c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.872514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7698173-57ef-459c-8ac2-35142bc1c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.873017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7698173-57ef-459c-8ac2-35142bc1c18c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.874258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7698173-57ef-459c-8ac2-35142bc1c18c admin admin] RBAC: Adding query filter params (interface=admin, service_id=ef3d9760bfa745b28a41cec95d48c2b1, region_id=RegionOne) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:14.874804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7698173-57ef-459c-8ac2-35142bc1c18c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.876788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7698173-57ef-459c-8ac2-35142bc1c18c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.883217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 502/995] 10.222.0.31 () {56 vars in 1270 bytes} [Sat Feb 12 04:00:14 2022] GET /identity/v3/endpoints?service_id=ef3d9760bfa745b28a41cec95d48c2b1&interface=admin®ion_id=RegionOne => generated 193 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:14.890084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:14.901751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfe39-fea3-44ae-921a-c9d43cb78953 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:14.906784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84feb8a-a0f5-45a3-8653-b0de24111cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:14.907547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84feb8a-a0f5-45a3-8653-b0de24111cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:14.907836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84feb8a-a0f5-45a3-8653-b0de24111cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:14.908116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84feb8a-a0f5-45a3-8653-b0de24111cc9 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:14.908828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84feb8a-a0f5-45a3-8653-b0de24111cc9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:14.910565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84feb8a-a0f5-45a3-8653-b0de24111cc9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:14.918134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 494/996] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:00:14 2022] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:00:15.838982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec8b8c-4e15-498b-b789-5c332c76cbcb None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:15.839557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec8b8c-4e15-498b-b789-5c332c76cbcb None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:15.839557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec8b8c-4e15-498b-b789-5c332c76cbcb None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:15.841336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 503/997] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:15.847813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b9a0-9527-496a-98d3-18b301f53b60 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:15.848298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b9a0-9527-496a-98d3-18b301f53b60 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:15.848373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8b9a0-9527-496a-98d3-18b301f53b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:15.865632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-91f8b9a0-9527-496a-98d3-18b301f53b60 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:15.866804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-91f8b9a0-9527-496a-98d3-18b301f53b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:15.874411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 495/998] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:15 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:15.897550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec8b8c-4e15-498b-b789-5c332c76cbcb None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:15.910244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec8b8c-4e15-498b-b789-5c332c76cbcb None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:15.914647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:15.915416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:15.915693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:15.967297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:15.967297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:15.967297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:15.967297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 12 04:00:15.967297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 504/999] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:15.967744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b9a0-9527-496a-98d3-18b301f53b60 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:15.967744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8b9a0-9527-496a-98d3-18b301f53b60 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:15.967744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:15.967744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:15.968002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:15.968002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:15.968002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:15.968002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:15.968002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:15.968002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 496/1000] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 04:00:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:15.968352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:15.975665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64557104-124f-4ea7-b82f-69fbb92c86f2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:15.980259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:15.980904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:15.981189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:15.981511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:15.982219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:15.982529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:15.984139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:15.989394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 505/1001] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 04:00:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:15.995123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:16.005822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd0fb1-f2eb-417e-9221-be3887954576 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:16.010515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f82144-dd6f-4964-905c-622000541a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:16.011152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82144-dd6f-4964-905c-622000541a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:16.011431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82144-dd6f-4964-905c-622000541a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:16.011703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f82144-dd6f-4964-905c-622000541a08 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:16.012494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f82144-dd6f-4964-905c-622000541a08 admin admin] RBAC: Adding query filter params (interface=public, service_id=9bbb415f49a24f88b456436c81d923d7, region_id=RegionOne) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:16.012800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f82144-dd6f-4964-905c-622000541a08 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:16.014462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f82144-dd6f-4964-905c-622000541a08 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:16.020271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 497/1002] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 04:00:15 2022] GET /identity/v3/endpoints?service_id=9bbb415f49a24f88b456436c81d923d7&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:16.025676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:16.036128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3767c-45fc-4832-b4ca-60ef065b23f4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:16.041054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c51cec-39b4-4b17-aa28-c8ebbc77b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:16.041757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51cec-39b4-4b17-aa28-c8ebbc77b656 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:16.042028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51cec-39b4-4b17-aa28-c8ebbc77b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:16.042305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51cec-39b4-4b17-aa28-c8ebbc77b656 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:16.042997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c51cec-39b4-4b17-aa28-c8ebbc77b656 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:16.044583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c51cec-39b4-4b17-aa28-c8ebbc77b656 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:16.056250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 506/1003] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:00:16 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:00:16.933126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c813-987d-411e-8063-1fa52fdd274c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:16.933698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c813-987d-411e-8063-1fa52fdd274c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:16.933698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c813-987d-411e-8063-1fa52fdd274c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:16.935594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 498/1004] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:16.941455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c2e4-8a26-492e-a3fd-388e50d171ff None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:16.941903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c2e4-8a26-492e-a3fd-388e50d171ff None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:16.942075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c2e4-8a26-492e-a3fd-388e50d171ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:16.960355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-7fc2c2e4-8a26-492e-a3fd-388e50d171ff None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:16.962127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7fc2c2e4-8a26-492e-a3fd-388e50d171ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:16.970496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 507/1005] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:16 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:16.992725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198c813-987d-411e-8063-1fa52fdd274c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.005305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198c813-987d-411e-8063-1fa52fdd274c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.009549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.010307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.010583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.010850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.011502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.013070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.024302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 12 04:00:17.025697 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 499/1006] 10.222.0.31 () {56 vars in 1126 bytes} [Sat Feb 12 04:00:16 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:17.031790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c2e4-8a26-492e-a3fd-388e50d171ff None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.041024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c2e4-8a26-492e-a3fd-388e50d171ff None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.045464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.046631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.046909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.047182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.047896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:17.048199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.049798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.054834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 508/1007] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:17.060166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.070451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5bce-b5f0-4ca0-b5c5-9d44ce78003f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.074976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.075619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.075896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.076167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.076917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:17.077226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.078836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.084010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 500/1008] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:17.089878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.099526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e26719-e3f9-4d68-8492-f5fbead5bc49 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.104076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de685383-1ff1-4b8f-a75b-f8d164004b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.104797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de685383-1ff1-4b8f-a75b-f8d164004b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.105151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de685383-1ff1-4b8f-a75b-f8d164004b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.105522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de685383-1ff1-4b8f-a75b-f8d164004b81 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.106388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de685383-1ff1-4b8f-a75b-f8d164004b81 admin admin] RBAC: Adding query filter params (interface=public, service_id=149668c96d074437a02abb7cdfe50b69, region_id=RegionOne) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:17.106773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de685383-1ff1-4b8f-a75b-f8d164004b81 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.108916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de685383-1ff1-4b8f-a75b-f8d164004b81 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.114068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 509/1009] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 04:00:17 2022] GET /identity/v3/endpoints?service_id=149668c96d074437a02abb7cdfe50b69&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:17.119606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.126668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4b0f-6930-4752-9eda-5cbd0954477a None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.127131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4b0f-6930-4752-9eda-5cbd0954477a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.127434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4b0f-6930-4752-9eda-5cbd0954477a None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.129138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 510/1010] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:17.130028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c74ba4-f8cb-4450-9d54-8211e3aaca62 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.134535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da53fb-171e-410c-8056-60eff9cbf0ec None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.134648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.134884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da53fb-171e-410c-8056-60eff9cbf0ec None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.135160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da53fb-171e-410c-8056-60eff9cbf0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.135272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.135475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.135752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.136496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.138070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.144843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 501/1011] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:00:17 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:00:17.153770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d7da53fb-171e-410c-8056-60eff9cbf0ec None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:17.155105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d7da53fb-171e-410c-8056-60eff9cbf0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:17.163680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 511/1012] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:17 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:17.188130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.198345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2aeae2-a150-46b3-99df-882d651081b1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.203135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.203962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.204238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.204506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.205181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.206860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.219036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:00:17.221316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 502/1013] 10.222.0.31 () {56 vars in 1147 bytes} [Sat Feb 12 04:00:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:17.226826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da53fb-171e-410c-8056-60eff9cbf0ec None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.236867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da53fb-171e-410c-8056-60eff9cbf0ec None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.241540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.242218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.242500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.242776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.243515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:17.243819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.245451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.251693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 512/1014] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:17.257501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.268452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa7a51-b363-4b1e-b1eb-113c8a678ed6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.273218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068a56-c4e1-4a2c-a730-ad0afe508e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.273921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068a56-c4e1-4a2c-a730-ad0afe508e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.274205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068a56-c4e1-4a2c-a730-ad0afe508e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.274481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068a56-c4e1-4a2c-a730-ad0afe508e6d admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.275209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8068a56-c4e1-4a2c-a730-ad0afe508e6d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:17.275518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8068a56-c4e1-4a2c-a730-ad0afe508e6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.281194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8068a56-c4e1-4a2c-a730-ad0afe508e6d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.287750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 503/1015] 10.222.0.31 () {56 vars in 1143 bytes} [Sat Feb 12 04:00:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:17.289023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:17.299544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b98a-9ce1-49df-b81c-a1e94f753f4a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:17.304808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c497c1-b448-49c6-958f-e437474f91cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:17.305488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c497c1-b448-49c6-958f-e437474f91cc admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:17.305774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c497c1-b448-49c6-958f-e437474f91cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:17.306067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c497c1-b448-49c6-958f-e437474f91cc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:17.307643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c497c1-b448-49c6-958f-e437474f91cc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:17.309240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c497c1-b448-49c6-958f-e437474f91cc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:17.395382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 513/1016] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 04:00:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:18.267787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f8df4-1e98-4898-8953-eae4c05c7e1a None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:18.268359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f8df4-1e98-4898-8953-eae4c05c7e1a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:18.268359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f8df4-1e98-4898-8953-eae4c05c7e1a None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:18.270244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 504/1017] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:18.275458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8740d-611a-43ae-b6cd-753e35edbe66 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:18.275876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8740d-611a-43ae-b6cd-753e35edbe66 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:18.277372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8740d-611a-43ae-b6cd-753e35edbe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:18.294119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9ef8740d-611a-43ae-b6cd-753e35edbe66 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:18.295291 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9ef8740d-611a-43ae-b6cd-753e35edbe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:18.311965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 514/1018] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:18 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:18.334181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f8df4-1e98-4898-8953-eae4c05c7e1a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:18.346835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f8df4-1e98-4898-8953-eae4c05c7e1a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:18.351087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:18.351853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:18.352131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:18.352401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:18.353059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:18.354680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:18.366106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 12 04:00:18.367490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 505/1019] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:18.373414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8740d-611a-43ae-b6cd-753e35edbe66 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:18.383058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8740d-611a-43ae-b6cd-753e35edbe66 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:18.387480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:18.388130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:18.388410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:18.388680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:18.389976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:18.390289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:18.391867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:18.396899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 515/1020] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 04:00:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:18.402273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:18.411774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8db1-5607-4f8d-9db8-097afc1de0f1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:18.416205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a6dd4-0774-454c-9b25-4aa0533d8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:18.416839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6dd4-0774-454c-9b25-4aa0533d8083 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:18.417116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6dd4-0774-454c-9b25-4aa0533d8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:18.417414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6dd4-0774-454c-9b25-4aa0533d8083 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:18.418124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a6dd4-0774-454c-9b25-4aa0533d8083 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:18.418426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a6dd4-0774-454c-9b25-4aa0533d8083 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:18.420005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a6dd4-0774-454c-9b25-4aa0533d8083 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:18.424902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 506/1021] 10.222.0.31 () {56 vars in 1133 bytes} [Sat Feb 12 04:00:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:18.430232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:18.440150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489a09d-2643-4c20-8465-5d7e70d36d55 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:18.444524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d66c4-18a9-4df0-b406-329d339459a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:18.445148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d66c4-18a9-4df0-b406-329d339459a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:18.445453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d66c4-18a9-4df0-b406-329d339459a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:18.445728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d66c4-18a9-4df0-b406-329d339459a3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:18.446479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d66c4-18a9-4df0-b406-329d339459a3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:18.448390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d66c4-18a9-4df0-b406-329d339459a3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:18.549410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 516/1022] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 04:00:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:19.376244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401bd44-377b-4078-9d86-424bbfbee724 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.376752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401bd44-377b-4078-9d86-424bbfbee724 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.376828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401bd44-377b-4078-9d86-424bbfbee724 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.378738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 507/1023] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:19.383916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2302-4625-48a5-8420-b3107be60af1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.384368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2302-4625-48a5-8420-b3107be60af1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.384559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2302-4625-48a5-8420-b3107be60af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.403974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a99f2302-4625-48a5-8420-b3107be60af1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:19.405772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a99f2302-4625-48a5-8420-b3107be60af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:19.422927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 517/1024] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:19 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:19.445234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401bd44-377b-4078-9d86-424bbfbee724 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:19.457873 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401bd44-377b-4078-9d86-424bbfbee724 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:19.462563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:19.463332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.463614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.463889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.464553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:19.466168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:19.476884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 12 04:00:19.478203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 508/1025] 10.222.0.31 () {56 vars in 1126 bytes} [Sat Feb 12 04:00:19 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:19.484519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2302-4625-48a5-8420-b3107be60af1 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:19.493948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2302-4625-48a5-8420-b3107be60af1 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:19.498523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:19.499300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.499655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.499998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.500795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] RBAC: Adding query filter params (name=image) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:19.501110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:19.502738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:19.512018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 518/1026] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:19.513231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:19.523885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e6348-350b-448d-89b8-8dddcd09c71b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:19.528494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215c68c-4154-4f11-af3b-6e89ed3a01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:19.529198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215c68c-4154-4f11-af3b-6e89ed3a01e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.529625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215c68c-4154-4f11-af3b-6e89ed3a01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.529910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215c68c-4154-4f11-af3b-6e89ed3a01e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.531201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215c68c-4154-4f11-af3b-6e89ed3a01e2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:19.531507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215c68c-4154-4f11-af3b-6e89ed3a01e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:19.533176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215c68c-4154-4f11-af3b-6e89ed3a01e2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:19.541310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 509/1027] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:19.543626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:19.553301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee629-24a5-4ad1-ae8d-07e02d66952a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:19.557800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:19.558441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.558733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.559002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.559745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:19.561381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:19.610959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7528f-9f9e-430f-900d-b4c32439e648 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.611366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7528f-9f9e-430f-900d-b4c32439e648 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.611710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7528f-9f9e-430f-900d-b4c32439e648 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.613594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 510/1028] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:00:19.618561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66ea2d-a38e-4e06-9277-37b0918e52c4 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.618849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66ea2d-a38e-4e06-9277-37b0918e52c4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.619129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66ea2d-a38e-4e06-9277-37b0918e52c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.636553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2e66ea2d-a38e-4e06-9277-37b0918e52c4 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:19.637749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2e66ea2d-a38e-4e06-9277-37b0918e52c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:19.645993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 511/1029] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:19 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:19.665575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 519/1030] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 04:00:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:19.670312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66ea2d-a38e-4e06-9277-37b0918e52c4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:19.680066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66ea2d-a38e-4e06-9277-37b0918e52c4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:19.696800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3963f65-c6c9-4e01-8e17-cff1caf0507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:19.697694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963f65-c6c9-4e01-8e17-cff1caf0507b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.697980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963f65-c6c9-4e01-8e17-cff1caf0507b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.698258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963f65-c6c9-4e01-8e17-cff1caf0507b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.699506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3963f65-c6c9-4e01-8e17-cff1caf0507b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:19.701305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3963f65-c6c9-4e01-8e17-cff1caf0507b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:19.708462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 512/1031] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:19.709531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:19.720660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e060-e188-4796-8bdf-4f77eed307f6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:19.725319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd190a-2399-48bc-a8e3-2ea02a052b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:19.725994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd190a-2399-48bc-a8e3-2ea02a052b08 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:19.726283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd190a-2399-48bc-a8e3-2ea02a052b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:19.726558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd190a-2399-48bc-a8e3-2ea02a052b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:19.727286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd190a-2399-48bc-a8e3-2ea02a052b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:19.729217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd190a-2399-48bc-a8e3-2ea02a052b08 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:19.845229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 520/1032] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:19 2022] POST /identity/v3/projects => generated 311 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:20.836470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfdef2-893e-42bb-8f45-3cbbb2e3c597 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:20.836984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfdef2-893e-42bb-8f45-3cbbb2e3c597 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:20.837091 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfdef2-893e-42bb-8f45-3cbbb2e3c597 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:20.839004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 513/1033] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:20.844369 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6d78f-d5dd-4ec4-9b59-cb8ef0d06cd6 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:20.844771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6d78f-d5dd-4ec4-9b59-cb8ef0d06cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:20.844970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6d78f-d5dd-4ec4-9b59-cb8ef0d06cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:20.862932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b5a6d78f-d5dd-4ec4-9b59-cb8ef0d06cd6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:20.864098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b5a6d78f-d5dd-4ec4-9b59-cb8ef0d06cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:20.922689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 521/1034] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:20.946009 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfdef2-893e-42bb-8f45-3cbbb2e3c597 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:20.957941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfdef2-893e-42bb-8f45-3cbbb2e3c597 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:20.962451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:20.963220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:20.963497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:20.963769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:20.973977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:20.981474 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:00:20.983545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 514/1035] 10.222.0.31 () {56 vars in 1141 bytes} [Sat Feb 12 04:00:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:20.989531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6d78f-d5dd-4ec4-9b59-cb8ef0d06cd6 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:20.999392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6d78f-d5dd-4ec4-9b59-cb8ef0d06cd6 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.004116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.004871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.005156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.005461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.006224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:21.006528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.008107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.016543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 522/1036] 10.222.0.31 () {56 vars in 1136 bytes} [Sat Feb 12 04:00:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:21.022210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.032127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9200819-6812-4492-b121-bea8fc8cbf00 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.036553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.037323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.037602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.037980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.048305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.050154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.067170 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:21.068565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 515/1037] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:21.074044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.083773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b61ea-96bc-4a06-ac63-3519c6a1a4ac admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.088819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.089500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.089848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.090190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.090986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:21.091357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.093055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.104920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 523/1038] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:21.111323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.120868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96561db-0ca6-4c90-a269-d374263679b0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.125938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.126768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.127115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.127389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.134500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.136480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.149536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:00:21.150778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 516/1039] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:21.156970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.166594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98773e5c-33b9-40ca-a22b-b520f64e39de admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.171651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.172358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.172707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.173047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.174012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:21.174398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.176301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.193341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 524/1040] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:21.198929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.208370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb50b1-982e-4a70-87ff-2b1c1d02c900 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.213086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.213741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.214015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.214286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.222530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.224260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.233717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 517/1041] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:21.239268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.249004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286a73a-72a1-43f1-8191-45724387a63c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.253604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.254451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.254814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.255193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.265239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.267130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.285370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:21.286593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 525/1042] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:21.292036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.301550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596404a-b50c-43e7-a744-9c2c43037a90 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.306261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.306900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.307188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.307464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.308194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:21.308498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.310113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.321455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 518/1043] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:21.326705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.336619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d51b4-40a7-4b78-ac00-cdf6c2250ab4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.341270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.342019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.342307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.343108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.349933 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.351875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.365118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:21.366424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 526/1044] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:21.371893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.381603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f5cc-7da8-4661-b4aa-56262b2c14f4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.386284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f060ba7-d1ee-48d1-ab3f-799c473ec658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.386927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060ba7-d1ee-48d1-ab3f-799c473ec658 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.387214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060ba7-d1ee-48d1-ab3f-799c473ec658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.387487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060ba7-d1ee-48d1-ab3f-799c473ec658 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.388279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f060ba7-d1ee-48d1-ab3f-799c473ec658 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:21.388589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f060ba7-d1ee-48d1-ab3f-799c473ec658 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.390510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f060ba7-d1ee-48d1-ab3f-799c473ec658 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.403459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 519/1045] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:21.410311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.421379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e45de-dfa9-44f8-a752-f510a735e511 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.425871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d8c73-9413-4d5e-8750-0d04c64c249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.426572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8c73-9413-4d5e-8750-0d04c64c249a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.426879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8c73-9413-4d5e-8750-0d04c64c249a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.427156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d8c73-9413-4d5e-8750-0d04c64c249a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.428018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d8c73-9413-4d5e-8750-0d04c64c249a admin admin] RBAC: Adding query filter params (role.id=abd007b93b0b4dd29ad18040a7ccbc54, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=4509a13ccb074c5e9d8440755da77cc4) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:21.428330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d8c73-9413-4d5e-8750-0d04c64c249a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:21.430208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d8c73-9413-4d5e-8750-0d04c64c249a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:21.435865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 527/1046] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/role_assignments?user.id=4509a13ccb074c5e9d8440755da77cc4&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=abd007b93b0b4dd29ad18040a7ccbc54 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:21.917460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efdeab-8783-448c-8504-08a3fa56e757 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.917974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efdeab-8783-448c-8504-08a3fa56e757 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.918051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efdeab-8783-448c-8504-08a3fa56e757 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.922976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 520/1047] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:21.925194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d8c0-c2ab-4c55-badb-0331a3ffb9d5 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.925639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d8c0-c2ab-4c55-badb-0331a3ffb9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.925782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d8c0-c2ab-4c55-badb-0331a3ffb9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:21.943660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b868d8c0-c2ab-4c55-badb-0331a3ffb9d5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:21.944826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b868d8c0-c2ab-4c55-badb-0331a3ffb9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:21.953374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 528/1048] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:21.975725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efdeab-8783-448c-8504-08a3fa56e757 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:21.988904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efdeab-8783-448c-8504-08a3fa56e757 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:21.993372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e0b2-3144-4b0c-bd96-11bd3afa33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:21.994050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e0b2-3144-4b0c-bd96-11bd3afa33fc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:21.994337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e0b2-3144-4b0c-bd96-11bd3afa33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:21.994609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e0b2-3144-4b0c-bd96-11bd3afa33fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:22.002626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e0b2-3144-4b0c-bd96-11bd3afa33fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:22.004448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e0b2-3144-4b0c-bd96-11bd3afa33fc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:22.013323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 521/1049] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:22.019746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d8c0-c2ab-4c55-badb-0331a3ffb9d5 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:22.028631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d8c0-c2ab-4c55-badb-0331a3ffb9d5 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:22.033643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e7541-424a-49e8-b84c-3e1f4c20fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:22.034453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7541-424a-49e8-b84c-3e1f4c20fb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:22.034686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7541-424a-49e8-b84c-3e1f4c20fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:22.034958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e7541-424a-49e8-b84c-3e1f4c20fb4e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:22.036131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e7541-424a-49e8-b84c-3e1f4c20fb4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:22.037854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e7541-424a-49e8-b84c-3e1f4c20fb4e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:22.039538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 529/1050] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:22.092276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cd6c-912d-459d-b734-cbde63cd3fdf None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:22.092610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cd6c-912d-459d-b734-cbde63cd3fdf None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:22.092889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cd6c-912d-459d-b734-cbde63cd3fdf None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:22.094972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 522/1051] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:22.100737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0c71-f156-482d-95b6-b1db16f7e668 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:22.101060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0c71-f156-482d-95b6-b1db16f7e668 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:22.101323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca0c71-f156-482d-95b6-b1db16f7e668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:22.119905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6eca0c71-f156-482d-95b6-b1db16f7e668 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:22.121148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6eca0c71-f156-482d-95b6-b1db16f7e668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:22.129874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 530/1052] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:22.155242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33cd6c-912d-459d-b734-cbde63cd3fdf None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:22.168234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33cd6c-912d-459d-b734-cbde63cd3fdf None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:22.172712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108aec3-05d5-463f-ac4c-e74dc51a05d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:22.173526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108aec3-05d5-463f-ac4c-e74dc51a05d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:22.173804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108aec3-05d5-463f-ac4c-e74dc51a05d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:22.174077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108aec3-05d5-463f-ac4c-e74dc51a05d4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:22.175308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108aec3-05d5-463f-ac4c-e74dc51a05d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:22.177015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108aec3-05d5-463f-ac4c-e74dc51a05d4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:22.178825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 523/1053] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:22.184821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca0c71-f156-482d-95b6-b1db16f7e668 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:22.194851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca0c71-f156-482d-95b6-b1db16f7e668 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:22.200185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f0a04-0d2e-4d97-ba8c-c71d97c65a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:22.200882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f0a04-0d2e-4d97-ba8c-c71d97c65a60 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:22.201139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f0a04-0d2e-4d97-ba8c-c71d97c65a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:22.201469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f0a04-0d2e-4d97-ba8c-c71d97c65a60 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:22.202772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f0a04-0d2e-4d97-ba8c-c71d97c65a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:22.204688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f0a04-0d2e-4d97-ba8c-c71d97c65a60 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:22.284754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 531/1054] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 04:00:22 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:23.644503 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c1bf-0376-4f59-94ea-556a2f96323d None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.645022 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c1bf-0376-4f59-94ea-556a2f96323d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.645111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c1bf-0376-4f59-94ea-556a2f96323d None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.646837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 524/1055] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:23.652073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0748-f858-486f-bae0-eeeac54326fe None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.652476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0748-f858-486f-bae0-eeeac54326fe None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.652635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0748-f858-486f-bae0-eeeac54326fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.670327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-224f0748-f858-486f-bae0-eeeac54326fe None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:23.671571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-224f0748-f858-486f-bae0-eeeac54326fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:23.680305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 532/1056] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:23.704692 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157c1bf-0376-4f59-94ea-556a2f96323d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:23.717058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157c1bf-0376-4f59-94ea-556a2f96323d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:23.721418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:23.722198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.722479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.722754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.732608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:23.739748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:00:23.740878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 525/1057] 10.222.0.31 () {56 vars in 1141 bytes} [Sat Feb 12 04:00:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:23.746852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f0748-f858-486f-bae0-eeeac54326fe None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:23.756260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f0748-f858-486f-bae0-eeeac54326fe None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:23.760738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:23.761414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.761696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.761969 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.762726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:23.763030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:23.765321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:23.774011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 533/1058] 10.222.0.31 () {56 vars in 1136 bytes} [Sat Feb 12 04:00:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:23.778751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:23.789375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3870dd-7f05-4bdd-aa70-6a00cf03cc9f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:23.793789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:23.794534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.794814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.795085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.805344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:23.807192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:23.823653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:23.824774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 526/1059] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:23.830431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:23.840266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614c4de-e4a4-402a-9757-d5f9330d6a94 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:23.844756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:23.845497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.845857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.846189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.846976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:23.847345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:23.848975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:23.861049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 534/1060] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:23.866791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:23.877137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1509c-b4cc-46e0-adfe-55247f533323 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:23.881712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:23.882477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.882761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.883039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.890358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:23.892356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:23.905670 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:00:23.906752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 527/1061] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 04:00:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:23.912457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:23.922870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b86d6c-40d4-4801-8a7d-f9643abe3af5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:23.927512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:23.928165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.928448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.928725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.929610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:23.929973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:23.931811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:23.950114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 535/1062] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 04:00:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:23.956128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:23.965968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b520605-7c33-4441-85aa-20f3b6ebd6e1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:23.971625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:23.972761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:23.973177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:23.973617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:23.985304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:23.987129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.003592 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:24.004799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 528/1063] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:24.010468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.020638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11e515-f3f5-4808-b50b-016abdefb948 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.025187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.025930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.026275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.026617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.027432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:24.027807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.029484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.041083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 536/1064] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:24.046694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.056306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d1cd9-448c-47b4-9d66-2516fc117619 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.060796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.061619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.061901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.062173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.068801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.070773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.083928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:24.085084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 529/1065] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:24.090995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.101142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f3e6-845d-48bd-98de-c8c20e07850f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.105650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f271ae4-3daa-4df1-abf3-42b9137dcaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.106284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f271ae4-3daa-4df1-abf3-42b9137dcaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.106567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f271ae4-3daa-4df1-abf3-42b9137dcaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.106862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f271ae4-3daa-4df1-abf3-42b9137dcaf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.107655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f271ae4-3daa-4df1-abf3-42b9137dcaf2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:24.107964 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f271ae4-3daa-4df1-abf3-42b9137dcaf2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.109812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f271ae4-3daa-4df1-abf3-42b9137dcaf2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.121449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 537/1066] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:24.127214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.137498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d073ed-5e18-4523-a458-dc50ee28b5df admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.142497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45c0bd-3516-4bb6-bf2a-8f0a613a9fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.143352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c0bd-3516-4bb6-bf2a-8f0a613a9fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.143635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c0bd-3516-4bb6-bf2a-8f0a613a9fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.143908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45c0bd-3516-4bb6-bf2a-8f0a613a9fc8 admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/4509a13ccb074c5e9d8440755da77cc4/roles/abd007b93b0b4dd29ad18040a7ccbc54` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.146226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45c0bd-3516-4bb6-bf2a-8f0a613a9fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=4509a13ccb074c5e9d8440755da77cc4, role_id=abd007b93b0b4dd29ad18040a7ccbc54)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.148849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45c0bd-3516-4bb6-bf2a-8f0a613a9fc8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.217449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 530/1067] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:00:24 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/4509a13ccb074c5e9d8440755da77cc4/roles/abd007b93b0b4dd29ad18040a7ccbc54 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:00:24.518428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bd88-defa-419f-9c1c-94671a96aa1d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.518627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bd88-defa-419f-9c1c-94671a96aa1d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.518900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bd88-defa-419f-9c1c-94671a96aa1d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.520667 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 538/1068] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:24.526205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04876-66b7-4873-aff0-2b45607c2b5a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.526491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04876-66b7-4873-aff0-2b45607c2b5a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.526767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04876-66b7-4873-aff0-2b45607c2b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.543880 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-3ec04876-66b7-4873-aff0-2b45607c2b5a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:24.545043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3ec04876-66b7-4873-aff0-2b45607c2b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:24.605238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 531/1069] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:24.629558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375bd88-defa-419f-9c1c-94671a96aa1d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.641617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375bd88-defa-419f-9c1c-94671a96aa1d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.645994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.646754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.647040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.647314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.657152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:24.663876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:00:24.665008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 539/1070] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:24.671209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04876-66b7-4873-aff0-2b45607c2b5a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.679892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04876-66b7-4873-aff0-2b45607c2b5a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.684330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.684994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.685299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.685582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.686893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:24.687197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.688770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.696835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 532/1071] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:24.702418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.712383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697365c-700b-4bef-a404-ead3c6514358 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.716776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.717654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.717935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.718209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] PATH_INFO: `/v3/users/14761ea3cafe47318e2c74481ce979d4` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.730673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] RBAC: Authorizing `identity:get_user(user_id=14761ea3cafe47318e2c74481ce979d4)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.732782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.734884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 540/1072] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/users/14761ea3cafe47318e2c74481ce979d4 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:24.740169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.750077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec40414-b01e-4abc-8c67-aab11948e454 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.754478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.755082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.755362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.755632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.763074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.764789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.773551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 533/1073] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:24.778581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.787769 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68367c-bf59-4a30-8f35-24bb24816706 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.792165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd72c5-e67e-4f2b-beda-56da65a09021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.792974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd72c5-e67e-4f2b-beda-56da65a09021 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.793252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd72c5-e67e-4f2b-beda-56da65a09021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.793567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd72c5-e67e-4f2b-beda-56da65a09021 admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.794720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd72c5-e67e-4f2b-beda-56da65a09021 admin admin] RBAC: Authorizing `identity:get_project(project_id=d47d57a000424273abe203f020350976)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.797185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd72c5-e67e-4f2b-beda-56da65a09021 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.798794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 541/1074] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/projects/d47d57a000424273abe203f020350976 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:24.804170 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:24.813168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603216d-3fae-4fdb-8876-4d1536052964 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:24.817660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946c0ef-8817-4273-8f2a-11e0462e02ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:24.818266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c0ef-8817-4273-8f2a-11e0462e02ab admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:24.818544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c0ef-8817-4273-8f2a-11e0462e02ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:24.818818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c0ef-8817-4273-8f2a-11e0462e02ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:24.819668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946c0ef-8817-4273-8f2a-11e0462e02ab admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=d47d57a000424273abe203f020350976, user.id=14761ea3cafe47318e2c74481ce979d4) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:24.819986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946c0ef-8817-4273-8f2a-11e0462e02ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:24.821804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946c0ef-8817-4273-8f2a-11e0462e02ab admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:24.826960 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 534/1075] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:24 2022] GET /identity/v3/role_assignments?user.id=14761ea3cafe47318e2c74481ce979d4&scope.project.id=d47d57a000424273abe203f020350976&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:26.403753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6579f-18b5-4c13-874e-3a43b3fc0af6 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.404292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6579f-18b5-4c13-874e-3a43b3fc0af6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.404292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6579f-18b5-4c13-874e-3a43b3fc0af6 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.406612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 542/1076] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:26.411733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168408b-217c-40fd-a3e3-abc55900b4a8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.412167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168408b-217c-40fd-a3e3-abc55900b4a8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.412287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168408b-217c-40fd-a3e3-abc55900b4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.430177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2168408b-217c-40fd-a3e3-abc55900b4a8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:26.431364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2168408b-217c-40fd-a3e3-abc55900b4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:26.438978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 535/1077] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:26.462720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6579f-18b5-4c13-874e-3a43b3fc0af6 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.475157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6579f-18b5-4c13-874e-3a43b3fc0af6 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.479463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.480240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.480520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.480796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.491269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:26.498420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:00:26.499592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 543/1078] 10.222.0.31 () {56 vars in 1141 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:26.505637 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168408b-217c-40fd-a3e3-abc55900b4a8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.514471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168408b-217c-40fd-a3e3-abc55900b4a8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.518902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.519540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.519817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.520088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.520837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:26.521137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.522751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.531327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 536/1079] 10.222.0.31 () {56 vars in 1136 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:26.536660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.547233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea04324-ccbe-4b9c-a1d5-b90a4bcc316e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.551816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.552580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.552863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.553137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.563270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.565079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.581272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:26.582440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 544/1080] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:26.588406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.598418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fd8ee-afa7-431b-8fb9-0331ad52d9f6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.602851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.603483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.603765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.604040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.604794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:26.605104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.606713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.618647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 537/1081] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:26.625067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.634928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a7232-5b7e-46cf-9ceb-0aa173f2413d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.639414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.640172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.640455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.640730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.647796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.649822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.663697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:00:26.664835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 545/1082] 10.222.0.31 () {56 vars in 1114 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:26.671236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.680735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47757f-a2f4-446e-bce2-1d868bde1c49 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.685145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.685819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.686096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.686367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.687199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:26.687501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.689346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.705589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 538/1083] 10.222.0.31 () {56 vars in 1154 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:26.711370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.721650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea7983-6621-4ea7-b22d-9073fbe76f6a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.726350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.727080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.727366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.727639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.737010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.738829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.748861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 546/1084] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:26.754705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.764754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40340d-10b0-42d1-a1e2-9542802a0c4d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.769111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.769912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.770176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.770447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.780197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.782082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.798408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:00:26.799517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 539/1085] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:26.805326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.814657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f34cf-1944-40af-a92d-edc37908b824 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.819177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.819814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.820099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.820377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.821104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:26.821443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.823009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.833831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 547/1086] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:26.839652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.849147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1d547-7e74-49f1-94de-05ca3c7d180f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.853619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.854376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.854653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.854922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.862016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.863931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.876772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:00:26.877910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 540/1087] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:00:26.883688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.893115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da307e9-7ce2-412b-a28f-5f9dd3ea3435 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.897579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a05a1f-6dc4-4784-9c19-0db9ff1f2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.898213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05a1f-6dc4-4784-9c19-0db9ff1f2695 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.898492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05a1f-6dc4-4784-9c19-0db9ff1f2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.898762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a05a1f-6dc4-4784-9c19-0db9ff1f2695 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.899542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05a1f-6dc4-4784-9c19-0db9ff1f2695 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:26.899848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05a1f-6dc4-4784-9c19-0db9ff1f2695 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.901678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a05a1f-6dc4-4784-9c19-0db9ff1f2695 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.913465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 548/1088] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:26.919341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:26.929999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837e56e-e2e5-497e-8f16-4304dbea3362 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:26.934423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72cefd-4178-4dba-bcb6-b6a8a88fd196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:26.935033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72cefd-4178-4dba-bcb6-b6a8a88fd196 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:26.935309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72cefd-4178-4dba-bcb6-b6a8a88fd196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:26.935581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72cefd-4178-4dba-bcb6-b6a8a88fd196 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:26.937003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72cefd-4178-4dba-bcb6-b6a8a88fd196 admin admin] RBAC: Adding query filter params (role.id=abd007b93b0b4dd29ad18040a7ccbc54, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=4509a13ccb074c5e9d8440755da77cc4) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:26.937327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72cefd-4178-4dba-bcb6-b6a8a88fd196 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:26.940084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72cefd-4178-4dba-bcb6-b6a8a88fd196 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:26.944681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 541/1089] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:26 2022] GET /identity/v3/role_assignments?user.id=4509a13ccb074c5e9d8440755da77cc4&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=abd007b93b0b4dd29ad18040a7ccbc54 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:27.002521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475bb6-a774-4a78-a4fe-424f919e2e82 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:27.002805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475bb6-a774-4a78-a4fe-424f919e2e82 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:27.003079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90475bb6-a774-4a78-a4fe-424f919e2e82 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:27.004890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 549/1090] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:27.011248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64233-8d2d-4f82-857b-727c3aa47d1b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:27.011532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64233-8d2d-4f82-857b-727c3aa47d1b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:27.011808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64233-8d2d-4f82-857b-727c3aa47d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:27.030962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-16a64233-8d2d-4f82-857b-727c3aa47d1b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:27.032252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-16a64233-8d2d-4f82-857b-727c3aa47d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:27.040024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 542/1091] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:27.063772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475bb6-a774-4a78-a4fe-424f919e2e82 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:27.076354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90475bb6-a774-4a78-a4fe-424f919e2e82 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:27.080911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:27.081770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:27.082047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:27.082319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:27.094034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:27.100773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:00:27.102263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 550/1092] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:27.108728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a64233-8d2d-4f82-857b-727c3aa47d1b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:27.117832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a64233-8d2d-4f82-857b-727c3aa47d1b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:27.123098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:27.124340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:27.124618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:27.124894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:27.125687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:27.125987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:27.127560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:27.136344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 543/1093] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:27.142407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:27.152636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17aa59-e180-4786-b81f-4953e96cb98f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:27.157753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:27.158613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:27.158888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:27.159162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] PATH_INFO: `/v3/users/14761ea3cafe47318e2c74481ce979d4` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:27.160365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] RBAC: Authorizing `identity:get_user(user_id=14761ea3cafe47318e2c74481ce979d4)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:27.162506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:27.164081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 551/1094] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:27 2022] GET /identity/v3/users/14761ea3cafe47318e2c74481ce979d4 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:27.169939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:27.179888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41e59-3961-40ac-9eca-8cb63051f6ad admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:27.184456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dfde-a835-4e94-b4ea-74e773ce9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:27.185335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dfde-a835-4e94-b4ea-74e773ce9074 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:27.185620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dfde-a835-4e94-b4ea-74e773ce9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:27.185895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dfde-a835-4e94-b4ea-74e773ce9074 admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:27.187618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dfde-a835-4e94-b4ea-74e773ce9074 admin admin] RBAC: Authorizing `identity:get_project(project_id=d47d57a000424273abe203f020350976)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:27.189721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dfde-a835-4e94-b4ea-74e773ce9074 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:27.191368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 544/1095] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:27 2022] GET /identity/v3/projects/d47d57a000424273abe203f020350976 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:27.197328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:27.207254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77a69f-dd62-4e70-ac4a-65a9c5c99556 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:27.212258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6bc19-70d5-4445-af71-9f02540cee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:27.213127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6bc19-70d5-4445-af71-9f02540cee78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:27.213446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6bc19-70d5-4445-af71-9f02540cee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:27.213722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6bc19-70d5-4445-af71-9f02540cee78 admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976/users/14761ea3cafe47318e2c74481ce979d4/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:27.215666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6bc19-70d5-4445-af71-9f02540cee78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47d57a000424273abe203f020350976, user_id=14761ea3cafe47318e2c74481ce979d4, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:27.218859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6bc19-70d5-4445-af71-9f02540cee78 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:27.291539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 552/1096] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:00:27 2022] PUT /identity/v3/projects/d47d57a000424273abe203f020350976/users/14761ea3cafe47318e2c74481ce979d4/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:00:29.476010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274492-878a-4db9-9857-9d4bd1c3a131 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.476584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274492-878a-4db9-9857-9d4bd1c3a131 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.476584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a274492-878a-4db9-9857-9d4bd1c3a131 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.478345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 545/1097] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:29.483701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b058-28e2-4522-9780-401dd3f26f6d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.484080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b058-28e2-4522-9780-401dd3f26f6d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.484257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b058-28e2-4522-9780-401dd3f26f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.501936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-8a52b058-28e2-4522-9780-401dd3f26f6d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:29.503101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8a52b058-28e2-4522-9780-401dd3f26f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:29.556376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 553/1098] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:29.580116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274492-878a-4db9-9857-9d4bd1c3a131 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:29.592104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a274492-878a-4db9-9857-9d4bd1c3a131 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:29.596898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:29.597719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.597999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.598270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.608606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:29.615294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:00:29.616401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 546/1099] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:29.621901 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b058-28e2-4522-9780-401dd3f26f6d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:29.630580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b058-28e2-4522-9780-401dd3f26f6d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:29.635059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:29.635697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.635981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.636258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.637013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:29.637352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:29.638925 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:29.646855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 554/1100] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:29.651948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:29.662145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e01354-36cd-4dd9-a271-5dc6cf415643 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:29.666580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:29.667385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.667663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.667937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] PATH_INFO: `/v3/users/14761ea3cafe47318e2c74481ce979d4` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.669131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=14761ea3cafe47318e2c74481ce979d4)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:29.671794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:29.673323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 547/1101] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:29 2022] GET /identity/v3/users/14761ea3cafe47318e2c74481ce979d4 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:29.678270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:29.687471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72178a3-4634-43ca-b5a4-1ea1a357a4f1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:29.691931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:29.692525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.692810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.693090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.700654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:29.702367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:29.710999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 555/1102] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:29.716313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:29.725821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee2a2-be4a-45c7-bf91-80619081ecc4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:29.730223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68eaab-6ab2-428a-ad16-f2cec2c36dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:29.730996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68eaab-6ab2-428a-ad16-f2cec2c36dee admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.731273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68eaab-6ab2-428a-ad16-f2cec2c36dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.731545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68eaab-6ab2-428a-ad16-f2cec2c36dee admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.732685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68eaab-6ab2-428a-ad16-f2cec2c36dee admin admin] RBAC: Authorizing `identity:get_project(project_id=d47d57a000424273abe203f020350976)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:29.735257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68eaab-6ab2-428a-ad16-f2cec2c36dee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:29.736962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 548/1103] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:29 2022] GET /identity/v3/projects/d47d57a000424273abe203f020350976 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:29.741983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:29.750203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7bf49-7901-4a98-b1ea-c754dda06d4d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:29.754669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca4282-618e-4709-95f3-ac85628e7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:29.755257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca4282-618e-4709-95f3-ac85628e7ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:29.755540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca4282-618e-4709-95f3-ac85628e7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:29.755819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca4282-618e-4709-95f3-ac85628e7ed5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:29.756633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca4282-618e-4709-95f3-ac85628e7ed5 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=d47d57a000424273abe203f020350976, user.id=14761ea3cafe47318e2c74481ce979d4) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:29.756944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca4282-618e-4709-95f3-ac85628e7ed5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:29.758736 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca4282-618e-4709-95f3-ac85628e7ed5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:29.764843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 556/1104] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:29 2022] GET /identity/v3/role_assignments?user.id=14761ea3cafe47318e2c74481ce979d4&scope.project.id=d47d57a000424273abe203f020350976&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:31.966004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2812d35-488e-409e-b3df-7ca0245e99dd None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:31.966558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2812d35-488e-409e-b3df-7ca0245e99dd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:31.966558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2812d35-488e-409e-b3df-7ca0245e99dd None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:31.968803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 549/1105] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:31.973938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692256d3-b7c1-47b7-8849-9da64a322d5f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:31.974367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692256d3-b7c1-47b7-8849-9da64a322d5f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:31.974488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692256d3-b7c1-47b7-8849-9da64a322d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:31.992275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-692256d3-b7c1-47b7-8849-9da64a322d5f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:31.993466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-692256d3-b7c1-47b7-8849-9da64a322d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:32.000907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 557/1106] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:32.025833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2812d35-488e-409e-b3df-7ca0245e99dd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:32.038040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2812d35-488e-409e-b3df-7ca0245e99dd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:32.042285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e988b-c0b9-44f8-b319-af678335be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:32.043021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e988b-c0b9-44f8-b319-af678335be1e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:32.043296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e988b-c0b9-44f8-b319-af678335be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:32.043565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e988b-c0b9-44f8-b319-af678335be1e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:32.044733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e988b-c0b9-44f8-b319-af678335be1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:32.046589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e988b-c0b9-44f8-b319-af678335be1e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:32.048103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 550/1107] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:32.053132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692256d3-b7c1-47b7-8849-9da64a322d5f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:32.061707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692256d3-b7c1-47b7-8849-9da64a322d5f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:32.066102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074aa65-25e5-46e1-85ae-bc7859a5cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:32.066789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074aa65-25e5-46e1-85ae-bc7859a5cf59 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:32.067012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074aa65-25e5-46e1-85ae-bc7859a5cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:32.067286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074aa65-25e5-46e1-85ae-bc7859a5cf59 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:32.067984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074aa65-25e5-46e1-85ae-bc7859a5cf59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:32.069892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074aa65-25e5-46e1-85ae-bc7859a5cf59 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:32.167906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 558/1108] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 04:00:32 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:34.409917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9761e-5b88-4cad-a051-49383f50d171 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:34.410452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9761e-5b88-4cad-a051-49383f50d171 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:34.410452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9761e-5b88-4cad-a051-49383f50d171 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:34.412193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 551/1109] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:34.417339 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4738-32ba-4fe8-975f-c1d24b14531f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:34.417723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4738-32ba-4fe8-975f-c1d24b14531f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:34.417896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4738-32ba-4fe8-975f-c1d24b14531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:34.435510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c27a4738-32ba-4fe8-975f-c1d24b14531f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:34.437247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c27a4738-32ba-4fe8-975f-c1d24b14531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:34.444682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 559/1110] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:34.467846 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9761e-5b88-4cad-a051-49383f50d171 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:34.479616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9761e-5b88-4cad-a051-49383f50d171 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:34.484456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:34.485264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:34.485635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:34.485903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] PATH_INFO: `/v3/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:34.487348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] RBAC: Authorizing `identity:get_role(role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:34.488348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:00:34.488348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 04:00:34.488348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 04:00:34.489197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:34.490482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 552/1111] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:34 2022] GET /identity/v3/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:34.495518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4738-32ba-4fe8-975f-c1d24b14531f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:34.505248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4738-32ba-4fe8-975f-c1d24b14531f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:34.509722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:34.510591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:34.510888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:34.511161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] PATH_INFO: `/v3/users/91fa8eaa4bfa469391065ea3fd3a3ce0` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:34.525444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] RBAC: Authorizing `identity:get_user(user_id=91fa8eaa4bfa469391065ea3fd3a3ce0)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:34.527554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:34.529173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 560/1112] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:34 2022] GET /identity/v3/users/91fa8eaa4bfa469391065ea3fd3a3ce0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:34.534945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:34.544207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacc7f-e910-46f9-8b67-b4b6198507b3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:34.549132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:34.549770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:34.550051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:34.550322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:34.557813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:34.559512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:34.568553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 553/1113] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:34.574020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:34.583301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04a83e-ee60-448d-9f8b-569ef0f2a190 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:34.588063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021677e-1881-4f79-b503-a51f75034be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:34.588881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021677e-1881-4f79-b503-a51f75034be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:34.589161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021677e-1881-4f79-b503-a51f75034be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:34.589462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021677e-1881-4f79-b503-a51f75034be3 admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:34.590621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021677e-1881-4f79-b503-a51f75034be3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d47d57a000424273abe203f020350976)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:34.592590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021677e-1881-4f79-b503-a51f75034be3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:34.594207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 561/1114] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:34 2022] GET /identity/v3/projects/d47d57a000424273abe203f020350976 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:34.599666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:34.608617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46722607-0e28-4fb9-b5b8-35575a8d099d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:34.612996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4114-60be-42a9-ac25-70d81f2c66be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:34.613625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4114-60be-42a9-ac25-70d81f2c66be admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:34.613901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4114-60be-42a9-ac25-70d81f2c66be admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:34.614172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4114-60be-42a9-ac25-70d81f2c66be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:34.614985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4114-60be-42a9-ac25-70d81f2c66be admin admin] RBAC: Adding query filter params (role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=d47d57a000424273abe203f020350976, user.id=91fa8eaa4bfa469391065ea3fd3a3ce0) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:34.615287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4114-60be-42a9-ac25-70d81f2c66be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:34.617050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4114-60be-42a9-ac25-70d81f2c66be admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:34.622143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 554/1115] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:34 2022] GET /identity/v3/role_assignments?user.id=91fa8eaa4bfa469391065ea3fd3a3ce0&scope.project.id=d47d57a000424273abe203f020350976&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:36.773136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1546c79-e987-4c7b-ac20-8104bbc265b3 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:36.773731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1546c79-e987-4c7b-ac20-8104bbc265b3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:36.773731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1546c79-e987-4c7b-ac20-8104bbc265b3 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:36.775459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 562/1116] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:36.780539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182e13-09dd-4ece-adab-77ad6b6410f6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:36.780956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182e13-09dd-4ece-adab-77ad6b6410f6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:36.781081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7182e13-09dd-4ece-adab-77ad6b6410f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:36.798771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b7182e13-09dd-4ece-adab-77ad6b6410f6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:36.799942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b7182e13-09dd-4ece-adab-77ad6b6410f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:36.807403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 555/1117] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:36.830243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1546c79-e987-4c7b-ac20-8104bbc265b3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:36.842302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1546c79-e987-4c7b-ac20-8104bbc265b3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:36.846567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:36.847378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:36.847660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:36.847936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] PATH_INFO: `/v3/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:36.849423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] RBAC: Authorizing `identity:get_role(role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:36.850423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:00:36.850423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 04:00:36.850423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 04:00:36.851285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:36.852556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 563/1118] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:36 2022] GET /identity/v3/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:36.858216 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7182e13-09dd-4ece-adab-77ad6b6410f6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:36.866703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7182e13-09dd-4ece-adab-77ad6b6410f6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:36.871069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:36.871886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:36.872161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:36.872427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] PATH_INFO: `/v3/users/91fa8eaa4bfa469391065ea3fd3a3ce0` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:36.874225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] RBAC: Authorizing `identity:get_user(user_id=91fa8eaa4bfa469391065ea3fd3a3ce0)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:36.876299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:36.877839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 556/1119] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:36 2022] GET /identity/v3/users/91fa8eaa4bfa469391065ea3fd3a3ce0 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:36.882771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:36.892058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac7249-5d04-4e50-8a32-8dae92adf67a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:36.896493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b3040-2464-4317-ad25-5bca7e4ed7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:36.897321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3040-2464-4317-ad25-5bca7e4ed7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:36.897607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3040-2464-4317-ad25-5bca7e4ed7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:36.897884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b3040-2464-4317-ad25-5bca7e4ed7e5 admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:36.899053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3040-2464-4317-ad25-5bca7e4ed7e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d47d57a000424273abe203f020350976)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:36.901434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b3040-2464-4317-ad25-5bca7e4ed7e5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:36.903106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 564/1120] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:36 2022] GET /identity/v3/projects/d47d57a000424273abe203f020350976 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:36.909595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:36.919553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252d8ba-31f3-456f-be63-fd54f90cc894 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:36.924523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4beb22-5688-4001-a3eb-0139b13a02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:36.925411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4beb22-5688-4001-a3eb-0139b13a02ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:36.925690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4beb22-5688-4001-a3eb-0139b13a02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:36.925963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4beb22-5688-4001-a3eb-0139b13a02ce admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976/users/91fa8eaa4bfa469391065ea3fd3a3ce0/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:36.928472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4beb22-5688-4001-a3eb-0139b13a02ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47d57a000424273abe203f020350976, user_id=91fa8eaa4bfa469391065ea3fd3a3ce0, role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:36.931096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4beb22-5688-4001-a3eb-0139b13a02ce admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:37.007841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 557/1121] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:00:36 2022] PUT /identity/v3/projects/d47d57a000424273abe203f020350976/users/91fa8eaa4bfa469391065ea3fd3a3ce0/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:00:39.155578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b3d9-555a-42c4-9fdf-f4bc4a643276 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:39.156127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b3d9-555a-42c4-9fdf-f4bc4a643276 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:39.156127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b3d9-555a-42c4-9fdf-f4bc4a643276 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:39.157911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 565/1122] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:39.163044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76533e5-fa30-4039-a759-d77d6bed78a8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:39.163449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76533e5-fa30-4039-a759-d77d6bed78a8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:39.163593 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76533e5-fa30-4039-a759-d77d6bed78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:39.181239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e76533e5-fa30-4039-a759-d77d6bed78a8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:39.182447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e76533e5-fa30-4039-a759-d77d6bed78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:39.245581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 558/1123] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:39.268622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b3d9-555a-42c4-9fdf-f4bc4a643276 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:39.281233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b3d9-555a-42c4-9fdf-f4bc4a643276 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:39.285662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:39.286492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:39.286768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:39.287041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] PATH_INFO: `/v3/roles/450cbbf3b11d43fdb5ac319ef11b7026` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:39.288489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] RBAC: Authorizing `identity:get_role(role_id=450cbbf3b11d43fdb5ac319ef11b7026)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:39.290128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:39.291469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 566/1124] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:39 2022] GET /identity/v3/roles/450cbbf3b11d43fdb5ac319ef11b7026 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:39.297826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76533e5-fa30-4039-a759-d77d6bed78a8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:39.306658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76533e5-fa30-4039-a759-d77d6bed78a8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:39.311161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:39.312002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:39.312280 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:39.312551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] PATH_INFO: `/v3/users/91fa8eaa4bfa469391065ea3fd3a3ce0` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:39.313850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] RBAC: Authorizing `identity:get_user(user_id=91fa8eaa4bfa469391065ea3fd3a3ce0)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:39.315948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:39.317635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 559/1125] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:39 2022] GET /identity/v3/users/91fa8eaa4bfa469391065ea3fd3a3ce0 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:39.322602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:39.331810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe034a8a-b3ec-461a-8130-f1a7777f3b6f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:39.336180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:39.337024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:39.337331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:39.337608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:39.345540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:39.347194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:39.355594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 567/1126] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:00:39.361380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:39.370431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278db49-4992-409a-8a00-e3edb79dbda3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:39.374895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcfe64-c513-40ae-aa11-9d25400c17c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:39.375675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcfe64-c513-40ae-aa11-9d25400c17c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:39.375957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcfe64-c513-40ae-aa11-9d25400c17c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:39.376234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcfe64-c513-40ae-aa11-9d25400c17c3 admin admin] PATH_INFO: `/v3/projects/d47d57a000424273abe203f020350976` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:39.377419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcfe64-c513-40ae-aa11-9d25400c17c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=d47d57a000424273abe203f020350976)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:39.379388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcfe64-c513-40ae-aa11-9d25400c17c3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:39.381101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 560/1127] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:39 2022] GET /identity/v3/projects/d47d57a000424273abe203f020350976 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:39.386198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:39.394364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760cef5-7d38-4520-8973-1d08f4efa091 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:39.398755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d53e64-2894-4dfc-9ad5-c6c3b74f1dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:39.399336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d53e64-2894-4dfc-9ad5-c6c3b74f1dde admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:39.399615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d53e64-2894-4dfc-9ad5-c6c3b74f1dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:39.399886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d53e64-2894-4dfc-9ad5-c6c3b74f1dde admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:39.400689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d53e64-2894-4dfc-9ad5-c6c3b74f1dde admin admin] RBAC: Adding query filter params (role.id=450cbbf3b11d43fdb5ac319ef11b7026, scope.project.id=d47d57a000424273abe203f020350976, user.id=91fa8eaa4bfa469391065ea3fd3a3ce0) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:39.400992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d53e64-2894-4dfc-9ad5-c6c3b74f1dde admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:39.402761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d53e64-2894-4dfc-9ad5-c6c3b74f1dde admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:39.408821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 568/1128] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:39 2022] GET /identity/v3/role_assignments?user.id=91fa8eaa4bfa469391065ea3fd3a3ce0&scope.project.id=d47d57a000424273abe203f020350976&role.id=450cbbf3b11d43fdb5ac319ef11b7026 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:41.588898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421879e-755e-4ff9-a604-c7dfd6d724a3 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:41.589434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421879e-755e-4ff9-a604-c7dfd6d724a3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:41.589526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421879e-755e-4ff9-a604-c7dfd6d724a3 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:41.591207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 561/1129] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:41.596927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6ce0e-4585-463d-ade6-e7a1dfce78d9 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:41.597321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6ce0e-4585-463d-ade6-e7a1dfce78d9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:41.597500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6ce0e-4585-463d-ade6-e7a1dfce78d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:41.615131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6eb6ce0e-4585-463d-ade6-e7a1dfce78d9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:41.616306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6eb6ce0e-4585-463d-ade6-e7a1dfce78d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:41.631075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 569/1130] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:41.654192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421879e-755e-4ff9-a604-c7dfd6d724a3 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:41.666434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421879e-755e-4ff9-a604-c7dfd6d724a3 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:41.670789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e4561-1def-4474-8ae2-064d65a86e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:41.671535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e4561-1def-4474-8ae2-064d65a86e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:41.671811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e4561-1def-4474-8ae2-064d65a86e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:41.672081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e4561-1def-4474-8ae2-064d65a86e83 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:41.673222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e4561-1def-4474-8ae2-064d65a86e83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:41.674892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e4561-1def-4474-8ae2-064d65a86e83 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:41.676402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 562/1131] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:41.681566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6ce0e-4585-463d-ade6-e7a1dfce78d9 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:41.690646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6ce0e-4585-463d-ade6-e7a1dfce78d9 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:41.695071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019289a3-7524-4978-a3a4-206e63fc9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:41.695694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019289a3-7524-4978-a3a4-206e63fc9c4c admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:41.695973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019289a3-7524-4978-a3a4-206e63fc9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:41.696246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019289a3-7524-4978-a3a4-206e63fc9c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:41.696957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019289a3-7524-4978-a3a4-206e63fc9c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:41.698860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019289a3-7524-4978-a3a4-206e63fc9c4c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:41.780629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 570/1132] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:41 2022] POST /identity/v3/projects => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:43.995264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e00f-524b-4f4f-aae9-509c93dfb1ff None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:43.995788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e00f-524b-4f4f-aae9-509c93dfb1ff None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:43.995788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e00f-524b-4f4f-aae9-509c93dfb1ff None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:43.997564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 563/1133] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:44.003159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1bc7-35b0-4187-9868-29bbfa836f9a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:44.003592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1bc7-35b0-4187-9868-29bbfa836f9a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:44.003695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce1bc7-35b0-4187-9868-29bbfa836f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:44.021219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5dce1bc7-35b0-4187-9868-29bbfa836f9a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:44.022410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5dce1bc7-35b0-4187-9868-29bbfa836f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:44.075881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 571/1134] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:44.100964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1e00f-524b-4f4f-aae9-509c93dfb1ff None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:44.112718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1e00f-524b-4f4f-aae9-509c93dfb1ff None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:44.116972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7fc8c-a807-4efb-8868-527edc81c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:44.117753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7fc8c-a807-4efb-8868-527edc81c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:44.118030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7fc8c-a807-4efb-8868-527edc81c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:44.118297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7fc8c-a807-4efb-8868-527edc81c6f2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:44.119452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7fc8c-a807-4efb-8868-527edc81c6f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:44.121096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7fc8c-a807-4efb-8868-527edc81c6f2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:44.122640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 564/1135] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:00:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:44.127903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce1bc7-35b0-4187-9868-29bbfa836f9a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:44.136557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce1bc7-35b0-4187-9868-29bbfa836f9a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:44.141588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9102-a52b-48b3-9eb4-1b3d7cb31d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:44.142227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9102-a52b-48b3-9eb4-1b3d7cb31d40 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:44.142513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9102-a52b-48b3-9eb4-1b3d7cb31d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:44.142793 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9102-a52b-48b3-9eb4-1b3d7cb31d40 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:44.143516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc9102-a52b-48b3-9eb4-1b3d7cb31d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:44.145437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc9102-a52b-48b3-9eb4-1b3d7cb31d40 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:44.231453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 572/1136] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 04:00:44 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:46.436967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935a9f-09d2-4bc2-8f78-193d1fd08c32 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.437644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935a9f-09d2-4bc2-8f78-193d1fd08c32 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.437644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935a9f-09d2-4bc2-8f78-193d1fd08c32 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.439291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 565/1137] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:46.444374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0269b-0d67-42b9-b1f4-7ca9536c0519 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.444794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0269b-0d67-42b9-b1f4-7ca9536c0519 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.444928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0269b-0d67-42b9-b1f4-7ca9536c0519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.462865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f3f0269b-0d67-42b9-b1f4-7ca9536c0519 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:46.464040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f3f0269b-0d67-42b9-b1f4-7ca9536c0519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:46.472187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 573/1138] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:46.494821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935a9f-09d2-4bc2-8f78-193d1fd08c32 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:46.506616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935a9f-09d2-4bc2-8f78-193d1fd08c32 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:46.510867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:46.511604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.511881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.512152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.522441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:46.529054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:00:46.530831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 566/1139] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:46.536188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0269b-0d67-42b9-b1f4-7ca9536c0519 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:46.544777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0269b-0d67-42b9-b1f4-7ca9536c0519 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:46.549175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:46.549836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.550118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.550394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.551179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:46.551486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:46.553059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:46.560923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 574/1140] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:46.566350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:46.576722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00660-44f2-46bd-843c-f85f604411a5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:46.581167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:46.582089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.582370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.582644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] PATH_INFO: `/v3/users/66729e8e3ec0497fba0ac8b9daf05d2a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.601354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] RBAC: Authorizing `identity:get_user(user_id=66729e8e3ec0497fba0ac8b9daf05d2a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:46.605121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:46.606864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 567/1141] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:46 2022] GET /identity/v3/users/66729e8e3ec0497fba0ac8b9daf05d2a => generated 286 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:46.612936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:46.622575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107a1ab-8354-4c6b-b288-01b1b59763db admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:46.626983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:46.627606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.627885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.628161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.635648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:46.637534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:46.646588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 575/1142] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:46.652294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:46.662301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664863-aafd-4e28-9f02-74023c77260a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:46.666784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81f66-9c2c-40e0-bbb3-69e5a15f0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:46.667604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81f66-9c2c-40e0-bbb3-69e5a15f0995 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.667882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81f66-9c2c-40e0-bbb3-69e5a15f0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.668156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81f66-9c2c-40e0-bbb3-69e5a15f0995 admin admin] PATH_INFO: `/v3/projects/850fd4f1154d49d9bc545760690b6ae2` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.669341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81f66-9c2c-40e0-bbb3-69e5a15f0995 admin admin] RBAC: Authorizing `identity:get_project(project_id=850fd4f1154d49d9bc545760690b6ae2)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:46.671553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81f66-9c2c-40e0-bbb3-69e5a15f0995 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:46.673319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 568/1143] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:46 2022] GET /identity/v3/projects/850fd4f1154d49d9bc545760690b6ae2 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:46.678632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:46.687530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a17b-0c77-4af0-992c-c2e5d52516d7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:46.691939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cd2b-0469-497c-bc96-9891d6e012be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:46.692538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cd2b-0469-497c-bc96-9891d6e012be admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:46.692816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cd2b-0469-497c-bc96-9891d6e012be admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:46.693089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cd2b-0469-497c-bc96-9891d6e012be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:46.693953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cd2b-0469-497c-bc96-9891d6e012be admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=850fd4f1154d49d9bc545760690b6ae2, user.id=66729e8e3ec0497fba0ac8b9daf05d2a) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:46.694261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cd2b-0469-497c-bc96-9891d6e012be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:46.696013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cd2b-0469-497c-bc96-9891d6e012be admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:46.701930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 576/1144] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:46 2022] GET /identity/v3/role_assignments?user.id=66729e8e3ec0497fba0ac8b9daf05d2a&scope.project.id=850fd4f1154d49d9bc545760690b6ae2&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:48.835934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f4dc-dcd9-451c-9ee8-3b6cdbf150b3 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:48.836739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f4dc-dcd9-451c-9ee8-3b6cdbf150b3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:48.836739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149f4dc-dcd9-451c-9ee8-3b6cdbf150b3 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:48.838514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 569/1145] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:48.844459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1974cf-67f5-42ed-a61d-f28526343276 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:48.844837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1974cf-67f5-42ed-a61d-f28526343276 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:48.845003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1974cf-67f5-42ed-a61d-f28526343276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:48.862075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-de1974cf-67f5-42ed-a61d-f28526343276 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:48.863243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-de1974cf-67f5-42ed-a61d-f28526343276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:48.870620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 577/1146] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:48.893321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149f4dc-dcd9-451c-9ee8-3b6cdbf150b3 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:48.906473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149f4dc-dcd9-451c-9ee8-3b6cdbf150b3 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:48.911029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:48.911779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:48.912058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:48.912330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:48.922214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:48.928839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:00:48.929975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 570/1147] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:48.936029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1974cf-67f5-42ed-a61d-f28526343276 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:48.944659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1974cf-67f5-42ed-a61d-f28526343276 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:48.949047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:48.949723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:48.950005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:48.950279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:48.951019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:48.951892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:48.953476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:48.961296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 578/1148] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:00:48.966840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:48.976564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bd16b-b06a-48a6-a9fe-f559d8d845ba admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:48.980987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:48.981823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:48.982103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:48.982400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] PATH_INFO: `/v3/users/66729e8e3ec0497fba0ac8b9daf05d2a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:48.983590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] RBAC: Authorizing `identity:get_user(user_id=66729e8e3ec0497fba0ac8b9daf05d2a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:48.985727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:48.987254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 571/1149] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:48 2022] GET /identity/v3/users/66729e8e3ec0497fba0ac8b9daf05d2a => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:48.992210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:49.001780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a480-08a3-418c-bc3e-af85a8b8ee16 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:49.006157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38156e4e-d513-4a85-bbc7-07c14f3101a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:49.006947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38156e4e-d513-4a85-bbc7-07c14f3101a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:49.007227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38156e4e-d513-4a85-bbc7-07c14f3101a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:49.007501 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38156e4e-d513-4a85-bbc7-07c14f3101a5 admin admin] PATH_INFO: `/v3/projects/850fd4f1154d49d9bc545760690b6ae2` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:49.008638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38156e4e-d513-4a85-bbc7-07c14f3101a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=850fd4f1154d49d9bc545760690b6ae2)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:49.010616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38156e4e-d513-4a85-bbc7-07c14f3101a5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:49.012160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 579/1150] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:48 2022] GET /identity/v3/projects/850fd4f1154d49d9bc545760690b6ae2 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:49.017861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:49.026819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187bd2-efea-43cc-ab4c-83fe937b02cc admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:49.031184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc480e54-218f-4d81-a9ad-8709f0042b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:49.031989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc480e54-218f-4d81-a9ad-8709f0042b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:49.032263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc480e54-218f-4d81-a9ad-8709f0042b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:49.032529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc480e54-218f-4d81-a9ad-8709f0042b25 admin admin] PATH_INFO: `/v3/projects/850fd4f1154d49d9bc545760690b6ae2/users/66729e8e3ec0497fba0ac8b9daf05d2a/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:49.034458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc480e54-218f-4d81-a9ad-8709f0042b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850fd4f1154d49d9bc545760690b6ae2, user_id=66729e8e3ec0497fba0ac8b9daf05d2a, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:49.036970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc480e54-218f-4d81-a9ad-8709f0042b25 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:49.110306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 572/1151] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:00:49 2022] PUT /identity/v3/projects/850fd4f1154d49d9bc545760690b6ae2/users/66729e8e3ec0497fba0ac8b9daf05d2a/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:00:51.257378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d929fc-d3a7-4859-bbb4-6e3dc3e30d72 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.257902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d929fc-d3a7-4859-bbb4-6e3dc3e30d72 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.257902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d929fc-d3a7-4859-bbb4-6e3dc3e30d72 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.259672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 580/1152] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:51.265581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d781e0-b1b2-498c-9462-b08f16491325 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.265985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d781e0-b1b2-498c-9462-b08f16491325 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.266132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d781e0-b1b2-498c-9462-b08f16491325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.284106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a5d781e0-b1b2-498c-9462-b08f16491325 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:51.285332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a5d781e0-b1b2-498c-9462-b08f16491325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:51.340176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 573/1153] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:51.363382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d929fc-d3a7-4859-bbb4-6e3dc3e30d72 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:51.375655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d929fc-d3a7-4859-bbb4-6e3dc3e30d72 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:51.379955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:51.380708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.380985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.381253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.391585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:00:51.398189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:00:51.399294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 581/1154] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:51.404983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d781e0-b1b2-498c-9462-b08f16491325 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:51.413551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d781e0-b1b2-498c-9462-b08f16491325 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:51.417959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:51.418587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.418863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.419133 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.419905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:51.420206 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:51.421811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:51.429611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 574/1155] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:51.434727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:51.444906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5922e-9710-46e5-908a-6871b7092f89 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:51.449248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:51.450084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.450363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.450637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] PATH_INFO: `/v3/users/66729e8e3ec0497fba0ac8b9daf05d2a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.452389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] RBAC: Authorizing `identity:get_user(user_id=66729e8e3ec0497fba0ac8b9daf05d2a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:51.454504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:51.456003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 582/1156] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:00:51 2022] GET /identity/v3/users/66729e8e3ec0497fba0ac8b9daf05d2a => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:51.461047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:51.470428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fe1fb-ea99-4369-8892-0dc35458df8e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:51.474865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:51.475472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.475750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.476022 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.483514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:51.485215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:51.493713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 575/1157] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:51.499620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:51.508985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8ccc9-25b4-4890-9de4-151f0b867032 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:51.513389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6302f4-4969-4765-ae29-face7f4f137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:51.514248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6302f4-4969-4765-ae29-face7f4f137f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.514528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6302f4-4969-4765-ae29-face7f4f137f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.514801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6302f4-4969-4765-ae29-face7f4f137f admin admin] PATH_INFO: `/v3/projects/850fd4f1154d49d9bc545760690b6ae2` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.515956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6302f4-4969-4765-ae29-face7f4f137f admin admin] RBAC: Authorizing `identity:get_project(project_id=850fd4f1154d49d9bc545760690b6ae2)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:51.517969 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6302f4-4969-4765-ae29-face7f4f137f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:51.519547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 583/1158] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:00:51 2022] GET /identity/v3/projects/850fd4f1154d49d9bc545760690b6ae2 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:51.524950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:51.533205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc600-5701-4c81-9352-96d989994fcf admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:51.537617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac670f-82c5-4e00-ab0d-d5268f278276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:51.538204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac670f-82c5-4e00-ab0d-d5268f278276 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:51.538479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac670f-82c5-4e00-ab0d-d5268f278276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:51.538751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac670f-82c5-4e00-ab0d-d5268f278276 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:51.539561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac670f-82c5-4e00-ab0d-d5268f278276 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=850fd4f1154d49d9bc545760690b6ae2, user.id=66729e8e3ec0497fba0ac8b9daf05d2a) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:51.539860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac670f-82c5-4e00-ab0d-d5268f278276 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:51.541657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac670f-82c5-4e00-ab0d-d5268f278276 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:51.547593 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 576/1159] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:00:51 2022] GET /identity/v3/role_assignments?user.id=66729e8e3ec0497fba0ac8b9daf05d2a&scope.project.id=850fd4f1154d49d9bc545760690b6ae2&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:53.722341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab453-979a-469d-9be9-15b1028766cd None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:53.722866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab453-979a-469d-9be9-15b1028766cd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:53.722866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab453-979a-469d-9be9-15b1028766cd None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:53.724630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 584/1160] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:53.729860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fb94b-2a75-4196-9eac-c61ac92049b9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:53.730249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fb94b-2a75-4196-9eac-c61ac92049b9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:53.730412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fb94b-2a75-4196-9eac-c61ac92049b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:53.747476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8e5fb94b-2a75-4196-9eac-c61ac92049b9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:53.749153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8e5fb94b-2a75-4196-9eac-c61ac92049b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:53.756643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 577/1161] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:53.778515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bab453-979a-469d-9be9-15b1028766cd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:53.790336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bab453-979a-469d-9be9-15b1028766cd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:53.794588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:53.795730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:53.796009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:53.796279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:53.803678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:53.805413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:53.814475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 585/1162] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:00:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:00:53.819904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fb94b-2a75-4196-9eac-c61ac92049b9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:53.828501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fb94b-2a75-4196-9eac-c61ac92049b9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:53.832930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77495aca-5771-4387-b21f-903b7e92fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:53.833722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495aca-5771-4387-b21f-903b7e92fbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:53.834005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495aca-5771-4387-b21f-903b7e92fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:53.834279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495aca-5771-4387-b21f-903b7e92fbaf admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:53.841169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77495aca-5771-4387-b21f-903b7e92fbaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:53.843041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77495aca-5771-4387-b21f-903b7e92fbaf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:53.856287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-77495aca-5771-4387-b21f-903b7e92fbaf admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 12 04:00:53.857891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 578/1163] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:00:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:00:53.863356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:53.871802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1b7e4-8132-4ff1-a85c-034f2f8ce826 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:53.876849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07302fb-80b3-4561-befd-54d0da8bdc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:53.877493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07302fb-80b3-4561-befd-54d0da8bdc0c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:53.877776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07302fb-80b3-4561-befd-54d0da8bdc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:53.878050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07302fb-80b3-4561-befd-54d0da8bdc0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:53.878765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07302fb-80b3-4561-befd-54d0da8bdc0c admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:00:53.879070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07302fb-80b3-4561-befd-54d0da8bdc0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:53.880592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07302fb-80b3-4561-befd-54d0da8bdc0c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:53.887545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 586/1164] 10.222.0.31 () {56 vars in 1136 bytes} [Sat Feb 12 04:00:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:56.055345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ecf4f-7acf-492f-a618-77cc58446a70 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:56.055867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ecf4f-7acf-492f-a618-77cc58446a70 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:56.055867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ecf4f-7acf-492f-a618-77cc58446a70 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:56.057689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 579/1165] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:56.063359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff551-4c2e-4509-833c-345dfb15711b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:56.063780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff551-4c2e-4509-833c-345dfb15711b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:56.063923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff551-4c2e-4509-833c-345dfb15711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:56.081133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-45fff551-4c2e-4509-833c-345dfb15711b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:56.082348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-45fff551-4c2e-4509-833c-345dfb15711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:56.090168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 587/1166] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:00:56.113488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ecf4f-7acf-492f-a618-77cc58446a70 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:56.125983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ecf4f-7acf-492f-a618-77cc58446a70 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:56.130278 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e79c9-0a6a-4fe3-ad49-9e6e859712db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:56.130905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e79c9-0a6a-4fe3-ad49-9e6e859712db admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:56.131186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e79c9-0a6a-4fe3-ad49-9e6e859712db admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:56.131459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e79c9-0a6a-4fe3-ad49-9e6e859712db admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:56.132207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e79c9-0a6a-4fe3-ad49-9e6e859712db admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:56.133219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-be3e79c9-0a6a-4fe3-ad49-9e6e859712db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:00:56.133219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 04:00:56.133219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 04:00:56.134116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e79c9-0a6a-4fe3-ad49-9e6e859712db admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:56.202141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 580/1167] 10.222.0.31 () {60 vars in 1159 bytes} [Sat Feb 12 04:00:56 2022] POST /identity/v3/domains => generated 267 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:00:58.521069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e5b9-6162-4c84-920e-aa7c0a388205 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:58.521643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e5b9-6162-4c84-920e-aa7c0a388205 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:58.521643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e5b9-6162-4c84-920e-aa7c0a388205 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:58.526313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 588/1168] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:00:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:00:58.532367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44991d-d91e-4b63-860b-8b4195f29390 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:58.532796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44991d-d91e-4b63-860b-8b4195f29390 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:58.532885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44991d-d91e-4b63-860b-8b4195f29390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:58.551581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1e44991d-d91e-4b63-860b-8b4195f29390 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:00:58.552757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1e44991d-d91e-4b63-860b-8b4195f29390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:00:58.610585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 581/1169] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:00:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:00:58.636199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e5b9-6162-4c84-920e-aa7c0a388205 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:58.649204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e5b9-6162-4c84-920e-aa7c0a388205 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:58.653601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56820e6-fc9d-4a03-b7b2-30aca82bca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:58.655011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56820e6-fc9d-4a03-b7b2-30aca82bca09 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:58.655290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56820e6-fc9d-4a03-b7b2-30aca82bca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:58.655562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56820e6-fc9d-4a03-b7b2-30aca82bca09 admin admin] PATH_INFO: `/v3/domains/98b2372f7f6e4cf69ad265423fd53ced` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:58.665883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56820e6-fc9d-4a03-b7b2-30aca82bca09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=98b2372f7f6e4cf69ad265423fd53ced)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:58.667828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56820e6-fc9d-4a03-b7b2-30aca82bca09 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:58.669431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 589/1170] 10.222.0.31 () {56 vars in 1204 bytes} [Sat Feb 12 04:00:58 2022] GET /identity/v3/domains/98b2372f7f6e4cf69ad265423fd53ced => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:00:58.675438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44991d-d91e-4b63-860b-8b4195f29390 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:00:58.684284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44991d-d91e-4b63-860b-8b4195f29390 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:00:58.689269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6266d-4fac-4b57-81f9-05e48527ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:00:58.689926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6266d-4fac-4b57-81f9-05e48527ade0 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:00:58.690204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6266d-4fac-4b57-81f9-05e48527ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:00:58.690476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6266d-4fac-4b57-81f9-05e48527ade0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:00:58.691186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6266d-4fac-4b57-81f9-05e48527ade0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:00:58.693088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6266d-4fac-4b57-81f9-05e48527ade0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:00:58.789488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 582/1171] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:00:58 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:01:00.974574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0612ce-9885-45df-a346-7502bc767ef0 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:00.975157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0612ce-9885-45df-a346-7502bc767ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:00.975157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0612ce-9885-45df-a346-7502bc767ef0 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:00.976909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 590/1172] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:01:00.982016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8d15-5fd7-47c4-98b2-3a782b85719b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:00.982947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8d15-5fd7-47c4-98b2-3a782b85719b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:00.983112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8d15-5fd7-47c4-98b2-3a782b85719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:01.114572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-200d8d15-5fd7-47c4-98b2-3a782b85719b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:01:01.115756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-200d8d15-5fd7-47c4-98b2-3a782b85719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:01:01.168478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 583/1173] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:01:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:01:01.193731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0612ce-9885-45df-a346-7502bc767ef0 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:01.205590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0612ce-9885-45df-a346-7502bc767ef0 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:01.209884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02f5e-8262-47b8-9272-f6bd4c659bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:01.210712 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02f5e-8262-47b8-9272-f6bd4c659bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:01.210995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02f5e-8262-47b8-9272-f6bd4c659bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:01.211272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02f5e-8262-47b8-9272-f6bd4c659bbf admin admin] PATH_INFO: `/v3/domains/98b2372f7f6e4cf69ad265423fd53ced` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:01.212712 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df02f5e-8262-47b8-9272-f6bd4c659bbf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=98b2372f7f6e4cf69ad265423fd53ced)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:01.214677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df02f5e-8262-47b8-9272-f6bd4c659bbf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:01.216202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 591/1174] 10.222.0.31 () {56 vars in 1204 bytes} [Sat Feb 12 04:01:01 2022] GET /identity/v3/domains/98b2372f7f6e4cf69ad265423fd53ced => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:01.221717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d8d15-5fd7-47c4-98b2-3a782b85719b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:01.230210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d8d15-5fd7-47c4-98b2-3a782b85719b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:01.234601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f29cc-42d0-4663-b2e1-361fd32cd154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:01.235231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f29cc-42d0-4663-b2e1-361fd32cd154 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:01.235507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f29cc-42d0-4663-b2e1-361fd32cd154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:01.235776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f29cc-42d0-4663-b2e1-361fd32cd154 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:01.236475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f29cc-42d0-4663-b2e1-361fd32cd154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:01.239343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f29cc-42d0-4663-b2e1-361fd32cd154 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:01.324976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 584/1175] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 04:01:01 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:01:03.547467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d850-1221-40fa-bb2d-68af0cc8b799 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.547977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d850-1221-40fa-bb2d-68af0cc8b799 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.547977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d850-1221-40fa-bb2d-68af0cc8b799 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.549733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 592/1176] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:01:03.554815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c533-3c95-4c84-b61b-41adea560ab8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.555235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c533-3c95-4c84-b61b-41adea560ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.555358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c533-3c95-4c84-b61b-41adea560ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.572980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a4c6c533-3c95-4c84-b61b-41adea560ab8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:01:03.574177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a4c6c533-3c95-4c84-b61b-41adea560ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:01:03.581579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 585/1177] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:01:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:01:03.604502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d850-1221-40fa-bb2d-68af0cc8b799 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:03.616791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d850-1221-40fa-bb2d-68af0cc8b799 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:03.621059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:03.621839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.622126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.622400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.633212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:01:03.640963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:01:03.642109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 593/1178] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:01:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:01:03.647921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c533-3c95-4c84-b61b-41adea560ab8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:03.657669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c533-3c95-4c84-b61b-41adea560ab8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:03.662102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:03.662749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.663026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.663297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.664058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:01:03.664361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:03.665979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:03.673922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 586/1179] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:03.679843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:03.689363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deef862-c588-4836-b342-c2722b220676 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:03.693828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:03.694659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.694940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.695215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] PATH_INFO: `/v3/users/9c8317d6fcbb4f46a67e19793991e023` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.708715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c8317d6fcbb4f46a67e19793991e023)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:03.710863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:03.712696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 594/1180] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:01:03 2022] GET /identity/v3/users/9c8317d6fcbb4f46a67e19793991e023 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:03.718508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:03.727810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7253cb-9b88-4ff7-9875-1463a8ad8fc3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:03.732285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:03.732895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.733176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.733481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.740996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:03.742742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:03.751383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 587/1181] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:01:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:01:03.756559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:03.766311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a8d5-44d8-46af-bf75-8b5cb0587060 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:03.770765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aa098-0d4e-4c3f-a673-8d66b6befcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:03.771574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa098-0d4e-4c3f-a673-8d66b6befcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.771862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa098-0d4e-4c3f-a673-8d66b6befcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.772140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aa098-0d4e-4c3f-a673-8d66b6befcd1 admin admin] PATH_INFO: `/v3/projects/03b710b339ba40adad8892281eef1143` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.773335 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aa098-0d4e-4c3f-a673-8d66b6befcd1 admin admin] RBAC: Authorizing `identity:get_project(project_id=03b710b339ba40adad8892281eef1143)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:03.775322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aa098-0d4e-4c3f-a673-8d66b6befcd1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:03.776952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 595/1182] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:01:03 2022] GET /identity/v3/projects/03b710b339ba40adad8892281eef1143 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:03.782207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:03.790486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e8ee4-eda3-4b0b-b874-5a46a48f38be admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:03.795385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb1ac-23d3-4112-bef3-eb5c7f0d7a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:03.795972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb1ac-23d3-4112-bef3-eb5c7f0d7a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:03.796245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb1ac-23d3-4112-bef3-eb5c7f0d7a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:03.796510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb1ac-23d3-4112-bef3-eb5c7f0d7a54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:03.797339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb1ac-23d3-4112-bef3-eb5c7f0d7a54 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=03b710b339ba40adad8892281eef1143, user.id=9c8317d6fcbb4f46a67e19793991e023) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:01:03.797688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb1ac-23d3-4112-bef3-eb5c7f0d7a54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:03.799398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb1ac-23d3-4112-bef3-eb5c7f0d7a54 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:03.804445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 588/1183] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:01:03 2022] GET /identity/v3/role_assignments?user.id=9c8317d6fcbb4f46a67e19793991e023&scope.project.id=03b710b339ba40adad8892281eef1143&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:06.023403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f860-4bc6-47e9-949a-283b69e92cc8 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:06.023958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f860-4bc6-47e9-949a-283b69e92cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:06.023958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604f860-4bc6-47e9-949a-283b69e92cc8 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:06.025945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 596/1184] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:01:06.031724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee771-e2bc-487d-a7a3-34ad55f4afae None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:06.032134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee771-e2bc-487d-a7a3-34ad55f4afae None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:06.032275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee771-e2bc-487d-a7a3-34ad55f4afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:06.049372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9e7ee771-e2bc-487d-a7a3-34ad55f4afae None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:01:06.050547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9e7ee771-e2bc-487d-a7a3-34ad55f4afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:01:06.058059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 589/1185] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:01:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:01:06.080646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604f860-4bc6-47e9-949a-283b69e92cc8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:06.093303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604f860-4bc6-47e9-949a-283b69e92cc8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:06.097585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:06.098333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:06.098615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:06.098889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:06.108697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:01:06.115391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:01:06.116495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 597/1186] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:01:06.121872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee771-e2bc-487d-a7a3-34ad55f4afae None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:06.130651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee771-e2bc-487d-a7a3-34ad55f4afae None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:06.135049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:06.135685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:06.135963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:06.136233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:06.137113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:01:06.137298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:06.139504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:06.147472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 590/1187] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:01:06.153302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:06.163893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41b2c4-91ce-4092-93e0-5efeb838e033 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:06.168248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:06.169068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:06.169378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:06.169679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] PATH_INFO: `/v3/users/9c8317d6fcbb4f46a67e19793991e023` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:06.170849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] RBAC: Authorizing `identity:get_user(user_id=9c8317d6fcbb4f46a67e19793991e023)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:06.172930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:06.174484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 598/1188] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:01:06 2022] GET /identity/v3/users/9c8317d6fcbb4f46a67e19793991e023 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:06.179462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:06.189016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fead0-0465-40cd-b6d3-a073332f59d5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:06.193406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b18bf0-c3fe-4d79-a038-bc4d2be50718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:06.194205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18bf0-c3fe-4d79-a038-bc4d2be50718 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:06.194480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18bf0-c3fe-4d79-a038-bc4d2be50718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:06.194747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18bf0-c3fe-4d79-a038-bc4d2be50718 admin admin] PATH_INFO: `/v3/projects/03b710b339ba40adad8892281eef1143` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:06.195900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b18bf0-c3fe-4d79-a038-bc4d2be50718 admin admin] RBAC: Authorizing `identity:get_project(project_id=03b710b339ba40adad8892281eef1143)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:06.197907 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b18bf0-c3fe-4d79-a038-bc4d2be50718 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:06.199466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 591/1189] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:01:06 2022] GET /identity/v3/projects/03b710b339ba40adad8892281eef1143 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:06.205296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:06.214482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949fd8e-0045-4da8-81af-875df416b1de admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:06.218863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c510d1-2201-43d2-9b2a-492dc0a8e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:06.219662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c510d1-2201-43d2-9b2a-492dc0a8e95d admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:06.219940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c510d1-2201-43d2-9b2a-492dc0a8e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:06.220210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c510d1-2201-43d2-9b2a-492dc0a8e95d admin admin] PATH_INFO: `/v3/projects/03b710b339ba40adad8892281eef1143/users/9c8317d6fcbb4f46a67e19793991e023/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:06.222119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c510d1-2201-43d2-9b2a-492dc0a8e95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b710b339ba40adad8892281eef1143, user_id=9c8317d6fcbb4f46a67e19793991e023, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:06.224612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c510d1-2201-43d2-9b2a-492dc0a8e95d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:06.304440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 599/1190] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:01:06 2022] PUT /identity/v3/projects/03b710b339ba40adad8892281eef1143/users/9c8317d6fcbb4f46a67e19793991e023/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:01:08.444294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d23c6-34ee-419b-aca3-22152cd00c51 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.444811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d23c6-34ee-419b-aca3-22152cd00c51 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.444811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d23c6-34ee-419b-aca3-22152cd00c51 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.446617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 592/1191] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:01:08.452478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fcde-f5b0-4a21-b4fb-270869e9f962 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.452870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fcde-f5b0-4a21-b4fb-270869e9f962 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.453020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fcde-f5b0-4a21-b4fb-270869e9f962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.470355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1aa5fcde-f5b0-4a21-b4fb-270869e9f962 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:01:08.471520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1aa5fcde-f5b0-4a21-b4fb-270869e9f962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:01:08.526920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 600/1192] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:01:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:01:08.549974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d23c6-34ee-419b-aca3-22152cd00c51 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:08.562147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d23c6-34ee-419b-aca3-22152cd00c51 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:08.566390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:08.567164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.567440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.567708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.577468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:01:08.584094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:01:08.585196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 593/1193] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:01:08.590898 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5fcde-f5b0-4a21-b4fb-270869e9f962 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:08.599944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5fcde-f5b0-4a21-b4fb-270869e9f962 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:08.604279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:08.604910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.605190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.605491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.606235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:01:08.606538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:08.608163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:08.615963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 601/1194] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:01:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:08.621114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:08.631160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee0a4-841a-4d92-a3f5-bb894084c608 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:08.635507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:08.636296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.636570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.636859 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] PATH_INFO: `/v3/users/9c8317d6fcbb4f46a67e19793991e023` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.638047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c8317d6fcbb4f46a67e19793991e023)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:08.640198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:08.641735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 594/1195] 10.222.0.31 () {56 vars in 1198 bytes} [Sat Feb 12 04:01:08 2022] GET /identity/v3/users/9c8317d6fcbb4f46a67e19793991e023 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:08.646900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:08.656549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73b56f-55ea-4b9c-ba1f-c4ed65083940 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:08.661066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:08.661706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.661992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.662270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.670374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:08.672096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:08.680696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 602/1196] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:01:08 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:01:08.685802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:08.694731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c448eb-af42-4400-a77a-4404f035bdf7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:08.699178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d83d14-43d3-4958-b0eb-441f30f6e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:08.699950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d83d14-43d3-4958-b0eb-441f30f6e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.700222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d83d14-43d3-4958-b0eb-441f30f6e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.700488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d83d14-43d3-4958-b0eb-441f30f6e1a3 admin admin] PATH_INFO: `/v3/projects/03b710b339ba40adad8892281eef1143` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.701665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d83d14-43d3-4958-b0eb-441f30f6e1a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=03b710b339ba40adad8892281eef1143)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:08.703631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d83d14-43d3-4958-b0eb-441f30f6e1a3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:08.705215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 595/1197] 10.222.0.31 () {56 vars in 1207 bytes} [Sat Feb 12 04:01:08 2022] GET /identity/v3/projects/03b710b339ba40adad8892281eef1143 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:01:08.710770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:01:08.720178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daefb7-0f10-46d7-8b8d-d4dbac1ffe0b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:01:08.724587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5ade7-5510-4975-9b24-5b70e933a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:01:08.725191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5ade7-5510-4975-9b24-5b70e933a561 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:01:08.725502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5ade7-5510-4975-9b24-5b70e933a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:01:08.725782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5ade7-5510-4975-9b24-5b70e933a561 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:01:08.726609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5ade7-5510-4975-9b24-5b70e933a561 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=03b710b339ba40adad8892281eef1143, user.id=9c8317d6fcbb4f46a67e19793991e023) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:01:08.726918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5ade7-5510-4975-9b24-5b70e933a561 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:01:08.728688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5ade7-5510-4975-9b24-5b70e933a561 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:01:08.735788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 603/1198] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:01:08 2022] GET /identity/v3/role_assignments?user.id=9c8317d6fcbb4f46a67e19793991e023&scope.project.id=03b710b339ba40adad8892281eef1143&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:30.882969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8c74-607d-4f9f-b3c7-bd4ab48a7b44 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:30.883567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8c74-607d-4f9f-b3c7-bd4ab48a7b44 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:30.883567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8c74-607d-4f9f-b3c7-bd4ab48a7b44 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:30.885817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 596/1199] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:30.891010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ae22b-5168-4f6f-8bab-bce12f13a137 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:30.891414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ae22b-5168-4f6f-8bab-bce12f13a137 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:30.891572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ae22b-5168-4f6f-8bab-bce12f13a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:30.909455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d69ae22b-5168-4f6f-8bab-bce12f13a137 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:30.910632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d69ae22b-5168-4f6f-8bab-bce12f13a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:30.918391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 604/1200] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:30.942333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8c74-607d-4f9f-b3c7-bd4ab48a7b44 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:30.954961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8c74-607d-4f9f-b3c7-bd4ab48a7b44 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:30.959271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:30.960024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:30.960298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:30.960567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:30.971134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:30.972975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:30.989673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:30.990860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 597/1201] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:30.997269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ae22b-5168-4f6f-8bab-bce12f13a137 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:31.006336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ae22b-5168-4f6f-8bab-bce12f13a137 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:31.011458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3353e4f-e346-489e-b5ee-71d670cd67c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:31.012088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353e4f-e346-489e-b5ee-71d670cd67c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:31.012367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353e4f-e346-489e-b5ee-71d670cd67c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:31.012638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353e4f-e346-489e-b5ee-71d670cd67c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:31.013388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3353e4f-e346-489e-b5ee-71d670cd67c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:31.013733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3353e4f-e346-489e-b5ee-71d670cd67c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:31.015316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3353e4f-e346-489e-b5ee-71d670cd67c2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:31.026386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 605/1202] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:31.031659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:31.041094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24941-c7c8-4284-b0a8-6339a3a954fb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:31.045596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df860db4-d807-44f8-a9da-3273ac0cfd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:31.046225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df860db4-d807-44f8-a9da-3273ac0cfd14 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:31.046510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df860db4-d807-44f8-a9da-3273ac0cfd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:31.046783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df860db4-d807-44f8-a9da-3273ac0cfd14 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:31.047493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df860db4-d807-44f8-a9da-3273ac0cfd14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:31.049412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df860db4-d807-44f8-a9da-3273ac0cfd14 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:31.183207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 598/1203] 10.222.0.31 () {60 vars in 1153 bytes} [Sat Feb 12 04:02:31 2022] POST /identity/v3/users => generated 251 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:02:33.373445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ff25-762c-4c62-9704-17fc349dc203 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.374014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ff25-762c-4c62-9704-17fc349dc203 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.374014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ff25-762c-4c62-9704-17fc349dc203 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.375763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 606/1204] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:33.380889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc478-d633-4fb2-b7f3-c513111c9c74 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.381356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc478-d633-4fb2-b7f3-c513111c9c74 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.381538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfc478-d633-4fb2-b7f3-c513111c9c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.399552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-23dfc478-d633-4fb2-b7f3-c513111c9c74 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:33.400762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-23dfc478-d633-4fb2-b7f3-c513111c9c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:33.408361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 599/1205] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:33.431941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ff25-762c-4c62-9704-17fc349dc203 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.444018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ff25-762c-4c62-9704-17fc349dc203 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.450451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.450451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.450451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.450451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.460972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:02:33.468074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:02:33.469260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 607/1206] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:33.474976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfc478-d633-4fb2-b7f3-c513111c9c74 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.483855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfc478-d633-4fb2-b7f3-c513111c9c74 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.488350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.488987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.489269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.489575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.490383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:33.490684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.492263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.500531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 600/1207] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:33.505760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.515549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2add1c4-e302-494c-9214-30465f23d718 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.520017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.524023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.524023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.524023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.531294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.533034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.549130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:33.552719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 608/1208] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:33.555579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.565497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97f30-2c7c-4162-8f19-ebf6ff1d1555 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.569991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.570575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.570853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.571128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.572397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:33.572702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.574304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.585633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 601/1209] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:33.591268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.600653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975f78-3a40-480e-b84f-38ad3186f905 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.605670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.606423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.606704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.606976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.613948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.615937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.629918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:02:33.633421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 609/1210] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:33.636414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.645915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca043-52ba-4e0c-a486-ed5f3f33f45f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.650465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.651101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.651381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.651657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.652486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:33.652790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.654687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.671404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 602/1211] 10.222.0.31 () {56 vars in 1164 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:33.676679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.686705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5a138-f947-4239-912d-dc810cb66c42 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.691370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.692025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.692298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.692567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.701291 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.705742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.711707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 610/1212] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:02:33.717991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.727527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41ed0-39ec-43a5-92f1-7bcc30066ae3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.732719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.734408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.734408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.734408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.744525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.746374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.762285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:33.763381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 603/1213] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:33.768718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.777241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03637189-aab1-4c13-9798-b431af7e0186 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.781850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.782419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.782699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.782972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.783686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:33.783986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.785561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.797193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 611/1214] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:33.802563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.812535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd678746-80a1-44f3-a7a0-0771fe0f7b7d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.817008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.817796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.818077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.818350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.824896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.826852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.839538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:02:33.840624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 604/1215] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:02:33.846015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.855908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d008c-7f5c-44a2-8e4f-ebf12d365a5a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.860385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2865d2-7b2e-4440-9f58-c85f77cbd051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.862829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2865d2-7b2e-4440-9f58-c85f77cbd051 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.862829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2865d2-7b2e-4440-9f58-c85f77cbd051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.862829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2865d2-7b2e-4440-9f58-c85f77cbd051 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.862829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2865d2-7b2e-4440-9f58-c85f77cbd051 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:33.862829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2865d2-7b2e-4440-9f58-c85f77cbd051 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.864468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2865d2-7b2e-4440-9f58-c85f77cbd051 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.876692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 612/1216] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:33.882193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:33.892091 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d7da-f934-431c-a63b-94d9a5f39b35 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:33.896644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55e4b-e263-4537-8caf-58eff92012b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:33.897251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55e4b-e263-4537-8caf-58eff92012b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:33.897566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55e4b-e263-4537-8caf-58eff92012b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:33.897841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55e4b-e263-4537-8caf-58eff92012b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:33.898673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55e4b-e263-4537-8caf-58eff92012b1 admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=8156242719464c85ae77a332fe5d5eb2) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:33.898975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55e4b-e263-4537-8caf-58eff92012b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:33.900799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55e4b-e263-4537-8caf-58eff92012b1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:33.906044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 605/1217] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:02:33 2022] GET /identity/v3/role_assignments?user.id=8156242719464c85ae77a332fe5d5eb2&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:36.073090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2003-96c4-4253-84bc-1fdec5fe9e94 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.073678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2003-96c4-4253-84bc-1fdec5fe9e94 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.073789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2003-96c4-4253-84bc-1fdec5fe9e94 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.075450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 613/1218] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:36.080688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b66fe-41b0-4274-bd7b-8d379f8ecbe8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.081079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b66fe-41b0-4274-bd7b-8d379f8ecbe8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.081222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b66fe-41b0-4274-bd7b-8d379f8ecbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.098925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-116b66fe-41b0-4274-bd7b-8d379f8ecbe8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:36.100089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-116b66fe-41b0-4274-bd7b-8d379f8ecbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:36.107662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 606/1219] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:36.129909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f2003-96c4-4253-84bc-1fdec5fe9e94 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.142234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f2003-96c4-4253-84bc-1fdec5fe9e94 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.146588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.151960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.151960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.151960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.158415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:02:36.165260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:02:36.166406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 614/1220] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:36.172241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b66fe-41b0-4274-bd7b-8d379f8ecbe8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.180932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b66fe-41b0-4274-bd7b-8d379f8ecbe8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.185530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.186196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.186477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.186756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.187558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:36.187863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.189484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.197893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 607/1221] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:36.203385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.213967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63ec3-c115-48c5-ad2e-4cdfeb845cb7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.218553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.219302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.219583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.219860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.229767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.231602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.248108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:36.249207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 615/1222] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:36.254477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.264420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1035f2-bcf6-4335-b1b9-1eb4ddb0f062 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.268963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.269622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.269903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.270175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.270900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:36.271204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.272779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.285908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 608/1223] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:36.291587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.301142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2b186-20a4-4c3c-a8dc-242b54c720a0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.305725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.307019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.307302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.307575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.314785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.316770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.330934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:02:36.332278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 616/1224] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:36.337675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.349030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9be3d-df7f-4156-837a-43d3fcf917f6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.351592 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.357574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.357574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.357574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.357574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:36.357574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.357574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.372891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 609/1225] 10.222.0.31 () {56 vars in 1164 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:36.378260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.388353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd581c-2f75-4705-a8b2-d5d1b3b7c0b6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.392833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.393639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.398557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.398557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.406198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.408071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.433456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:36.435438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 617/1226] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:02:36.441353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.451701 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59b017-2e71-4dbd-a6d2-e22c8d02dce9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.456256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.456889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.457169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.457472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.458199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:36.458499 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.460075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.471417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 610/1227] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:36.476864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.486396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8182c7-693e-40a2-bae0-d3893307ace7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.490942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.491693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.491973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.492250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.499503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.501459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.514612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:02:36.515701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 618/1228] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:36.521158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.530825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8459c18-d65f-4ab5-aa1f-911b6c73db16 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.535445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb02c8a-3c72-4ef8-8119-eece1d742939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.540419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb02c8a-3c72-4ef8-8119-eece1d742939 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.540419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb02c8a-3c72-4ef8-8119-eece1d742939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.540419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb02c8a-3c72-4ef8-8119-eece1d742939 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.540419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb02c8a-3c72-4ef8-8119-eece1d742939 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:36.540419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb02c8a-3c72-4ef8-8119-eece1d742939 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.540419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb02c8a-3c72-4ef8-8119-eece1d742939 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.551339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 611/1229] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:02:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:36.557597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:36.567769 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c99b2-3023-40c0-a1ac-b776ddab886a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:36.574960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbca62-b05b-4f78-b581-6e955dbb2141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:36.574960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbca62-b05b-4f78-b581-6e955dbb2141 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:36.574960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbca62-b05b-4f78-b581-6e955dbb2141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:36.574960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbca62-b05b-4f78-b581-6e955dbb2141 admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/8156242719464c85ae77a332fe5d5eb2/roles/a24e0024c3264885b078b73325e5b2ed` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:36.588873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbca62-b05b-4f78-b581-6e955dbb2141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=8156242719464c85ae77a332fe5d5eb2, role_id=a24e0024c3264885b078b73325e5b2ed)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:36.591452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbca62-b05b-4f78-b581-6e955dbb2141 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:36.719791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 619/1230] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:02:36 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/8156242719464c85ae77a332fe5d5eb2/roles/a24e0024c3264885b078b73325e5b2ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:02:38.941746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7ad53-3323-4695-80f3-066421dda856 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:38.942297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7ad53-3323-4695-80f3-066421dda856 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:38.942297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7ad53-3323-4695-80f3-066421dda856 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:38.944054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 612/1231] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:38.949941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e60ab-4a04-4309-9743-36fb27697fe3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:38.954254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e60ab-4a04-4309-9743-36fb27697fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:38.954254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e60ab-4a04-4309-9743-36fb27697fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:38.968597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e42e60ab-4a04-4309-9743-36fb27697fe3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:38.969839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e42e60ab-4a04-4309-9743-36fb27697fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:39.026581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 620/1232] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:39.050467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7ad53-3323-4695-80f3-066421dda856 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.062620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7ad53-3323-4695-80f3-066421dda856 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.067021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.067781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.068059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.068331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.078776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:02:39.085616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:02:39.086763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 613/1233] 10.222.0.31 () {56 vars in 1123 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:39.093459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e60ab-4a04-4309-9743-36fb27697fe3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.102644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e60ab-4a04-4309-9743-36fb27697fe3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.107386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.108035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.108375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.108654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.109505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:39.109805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.111398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.119584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 621/1234] 10.222.0.31 () {56 vars in 1124 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:39.125406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.139545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9730e7-6710-42c9-a80f-6125f577ea3d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.144471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.145232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.145541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.145813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.157038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.162222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.175423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:39.176534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 614/1235] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:39.182691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.192287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c2f05-1ff7-4e82-a814-dfed6f2b3c54 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.196672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.197326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.197611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.197919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.198683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:39.198992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.200555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.212121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 622/1236] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:39.217675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.227089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9d87-384a-4184-80d6-a75c10037bbb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.232122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.239640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.239640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.239640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.240906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.242964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.257315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:02:39.265557 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 615/1237] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:39.265667 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.273163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46649a2-1a94-4fc2-bff4-5a76362f98b9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.278294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.278936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.279213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.279486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.280328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:39.280630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.282481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.300038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 623/1238] 10.222.0.31 () {56 vars in 1164 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:39.305667 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.315337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c531e17-8784-45fd-80cc-fc0390a834d1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.319977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.320602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.320886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.321160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.330480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.332211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.341891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 616/1239] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:02:39.347680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.357806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e2350-fb32-499b-b654-197c454b0afa admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.362196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.362955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.363233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.363506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.373387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.375249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.391308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:39.392444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 624/1240] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:39.398140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.407341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65709-29b6-44d6-925b-31d1380aea08 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.411902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.414287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.414287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.414287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.414287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:39.414287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.416244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.427366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 617/1241] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:39.433102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.449346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9146-0650-4a03-b2bd-c6d3163a41a0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.449346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.449346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.449346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.449754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.456375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.458333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.471789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:02:39.472918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 625/1242] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:39.479161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.488666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878593-c2cf-4e13-9c97-b296656f525f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.493153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6b36d-b86e-4de9-9fab-6ccd600c122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.493816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6b36d-b86e-4de9-9fab-6ccd600c122f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.494096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6b36d-b86e-4de9-9fab-6ccd600c122f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.494371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6b36d-b86e-4de9-9fab-6ccd600c122f admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.495149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6b36d-b86e-4de9-9fab-6ccd600c122f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:39.495458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6b36d-b86e-4de9-9fab-6ccd600c122f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.497302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6b36d-b86e-4de9-9fab-6ccd600c122f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.508941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 618/1243] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:39.514779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:39.525528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a364f7-9668-4d2a-85fb-811a2dc64e8c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:39.530101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69cb3d-ab60-4f6a-8125-e98dc7ed569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:39.530706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69cb3d-ab60-4f6a-8125-e98dc7ed569b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:39.530985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69cb3d-ab60-4f6a-8125-e98dc7ed569b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:39.531255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69cb3d-ab60-4f6a-8125-e98dc7ed569b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:39.535433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69cb3d-ab60-4f6a-8125-e98dc7ed569b admin admin] RBAC: Adding query filter params (role.id=a24e0024c3264885b078b73325e5b2ed, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=8156242719464c85ae77a332fe5d5eb2) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:39.535433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69cb3d-ab60-4f6a-8125-e98dc7ed569b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:39.535433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69cb3d-ab60-4f6a-8125-e98dc7ed569b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:39.539891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 626/1244] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:02:39 2022] GET /identity/v3/role_assignments?user.id=8156242719464c85ae77a332fe5d5eb2&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=a24e0024c3264885b078b73325e5b2ed => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:41.773108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f11c4-8738-431a-8bac-640177a49bd4 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:41.773696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f11c4-8738-431a-8bac-640177a49bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:41.773696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f11c4-8738-431a-8bac-640177a49bd4 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:41.775977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 619/1245] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:41.781213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ceed1-7af0-4406-8397-9e7120b5ed9d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:41.781688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ceed1-7af0-4406-8397-9e7120b5ed9d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:41.781836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ceed1-7af0-4406-8397-9e7120b5ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:41.799511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1a8ceed1-7af0-4406-8397-9e7120b5ed9d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:41.800692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1a8ceed1-7af0-4406-8397-9e7120b5ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:41.808260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 627/1246] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:41.831652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f11c4-8738-431a-8bac-640177a49bd4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:41.844276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f11c4-8738-431a-8bac-640177a49bd4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:41.850536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:41.851289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:41.851566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:41.851836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:41.862356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:02:41.869030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:02:41.870212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 620/1247] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:41.876188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ceed1-7af0-4406-8397-9e7120b5ed9d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:41.885457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ceed1-7af0-4406-8397-9e7120b5ed9d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:41.889952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:41.890595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:41.890878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:41.891154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:41.891912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:41.892215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:41.893820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:41.902440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 628/1248] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:41.907929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:41.917911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fdd02-81da-45c5-8eda-e6c1364cb669 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:41.922290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:41.923029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:41.923306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:41.923576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:41.933256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:41.935089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:41.951427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:41.952526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 621/1249] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:41.958028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:41.968594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e104bf-da57-4021-89af-e4c3cee2feb0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:41.973268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:41.973935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:41.974215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:41.974492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:41.975267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:41.975575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:41.977188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:41.988813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 629/1250] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:42.003067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.004117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ce63c-fb6d-4f41-8f39-35fe46130493 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.008648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.010004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.010279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.010544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.017535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.019517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.033702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:02:42.034872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 622/1251] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:42.040948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.050851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f0ea9-9c01-4037-a28d-2c5a38cc8edf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.055395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.056041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.056321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.056590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.057471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:42.057780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.059595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.076884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 630/1252] 10.222.0.31 () {56 vars in 1164 bytes} [Sat Feb 12 04:02:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:42.082561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.093078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa178005-8c21-4df5-9768-ce36f5ff3a83 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.097706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.098325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.098612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.098887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.106466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.108192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.116920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 623/1253] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:02:42 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:02:42.122466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.132347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983bc3-61a4-4129-82eb-2eba3ac14aee admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.137551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.138323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.138601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.138872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.150212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.152073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.168383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:42.169543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 631/1254] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:42.175276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.183959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636ac12-30f9-4c24-b4ed-b0ad0319ceee admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.188610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.189240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.189553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.189828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.192693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:42.192693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.192693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.203817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 624/1255] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:42.209035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.219400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa3a4b-a8cb-4043-9803-a44bfdc635a5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.223930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.224683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.224961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.225235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.232099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.234074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.247301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:02:42.248415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 632/1256] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:42.254220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.264192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c226c1e-477c-4798-9e0e-3e5296902910 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.268744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a81fc-234a-4a8c-8e9e-ad4e0c27ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.269414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a81fc-234a-4a8c-8e9e-ad4e0c27ea79 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.269679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a81fc-234a-4a8c-8e9e-ad4e0c27ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.269954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a81fc-234a-4a8c-8e9e-ad4e0c27ea79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.270737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a81fc-234a-4a8c-8e9e-ad4e0c27ea79 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:42.271043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a81fc-234a-4a8c-8e9e-ad4e0c27ea79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.272866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a81fc-234a-4a8c-8e9e-ad4e0c27ea79 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.292746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 625/1257] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:42.292905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:42.301595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a349-20b7-41e1-b49d-04b7d6d29e6f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:42.306586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c805-268b-4efe-a68d-bb2548f57b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:42.307200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c805-268b-4efe-a68d-bb2548f57b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:42.307522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c805-268b-4efe-a68d-bb2548f57b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:42.307789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c805-268b-4efe-a68d-bb2548f57b22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:42.308619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c805-268b-4efe-a68d-bb2548f57b22 admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=8156242719464c85ae77a332fe5d5eb2) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:42.308924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c805-268b-4efe-a68d-bb2548f57b22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:42.310775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c805-268b-4efe-a68d-bb2548f57b22 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:42.316134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 633/1258] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:02:42 2022] GET /identity/v3/role_assignments?user.id=8156242719464c85ae77a332fe5d5eb2&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:44.480136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4bfb-59c1-4858-aac2-b9c9a4bfb0e7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.480654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4bfb-59c1-4858-aac2-b9c9a4bfb0e7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.480745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4bfb-59c1-4858-aac2-b9c9a4bfb0e7 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.482476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 626/1259] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:44.487612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b71a-8ebd-4bce-95bf-0d67b995a804 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.488026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b71a-8ebd-4bce-95bf-0d67b995a804 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.488161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80b71a-8ebd-4bce-95bf-0d67b995a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.506013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3e80b71a-8ebd-4bce-95bf-0d67b995a804 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:44.507196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3e80b71a-8ebd-4bce-95bf-0d67b995a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:44.514719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 634/1260] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:44.537595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4bfb-59c1-4858-aac2-b9c9a4bfb0e7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.550339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4bfb-59c1-4858-aac2-b9c9a4bfb0e7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.554699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.555456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.555735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.556008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.565987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:02:44.572715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:02:44.573855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 627/1261] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:44.579240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80b71a-8ebd-4bce-95bf-0d67b995a804 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.588702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80b71a-8ebd-4bce-95bf-0d67b995a804 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.593214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.593880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.594165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.594441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.595195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:44.595503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.597089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.606498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 635/1262] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:44.611968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.622008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d28e8-3b2c-4cde-8d09-d9440e440825 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.627243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.627991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.628267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.628531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.638635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.640460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.658523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:44.659674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 628/1263] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:44.665976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.675548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab8e6-e4f4-4c17-9132-1f39a36bac01 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.680040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.680675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.681735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.681735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.682052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:44.682360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.683934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.695151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 636/1264] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:44.700663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.709921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fc396-17cf-4dac-a843-87d14cc4b8b5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.715136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.715885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.716158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.716438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.723455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.725504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.739368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:02:44.740481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 629/1265] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:44.746046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.755497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4686b49-f1a1-45c2-bc81-9f66ea4015d2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.760043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.762236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.762236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.762236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.762236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:44.762563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.764262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.782258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 637/1266] 10.222.0.31 () {56 vars in 1164 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:44.787697 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.797527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ec60a-048e-41bf-abc0-027909567f34 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.802206 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.802966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.803241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.803511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.813478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.815275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.831382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:44.832542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 630/1267] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:44.838810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.848328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed666b-3bb0-4360-9d51-47652c07e988 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.853349 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.853973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.854251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.854520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.855338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:44.855640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.857187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.868099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 638/1268] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:44.873125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.882500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e907e22-e857-4934-84aa-7f88e9a2cb40 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.887513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.891918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.891918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.891918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.895311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.897217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.910323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:02:44.911408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 631/1269] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:44.916789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.926321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef5c6b-44ab-4bc9-b022-3c316c5ced00 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.930967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff47b-3a6e-4d86-ad2d-0654a0ef5829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.931588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff47b-3a6e-4d86-ad2d-0654a0ef5829 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.931867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff47b-3a6e-4d86-ad2d-0654a0ef5829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.932141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff47b-3a6e-4d86-ad2d-0654a0ef5829 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.932919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff47b-3a6e-4d86-ad2d-0654a0ef5829 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:44.933222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff47b-3a6e-4d86-ad2d-0654a0ef5829 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.935087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff47b-3a6e-4d86-ad2d-0654a0ef5829 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:44.947265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 639/1270] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:44.952895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:44.963524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33a09c-8fa5-4e89-be2a-d752f23249c9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:44.968077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba022f-9423-4c33-a2b7-17b9206ab64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:44.968917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba022f-9423-4c33-a2b7-17b9206ab64f admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:44.969195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba022f-9423-4c33-a2b7-17b9206ab64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:44.969507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba022f-9423-4c33-a2b7-17b9206ab64f admin admin] PATH_INFO: `/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/8156242719464c85ae77a332fe5d5eb2/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:44.971456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba022f-9423-4c33-a2b7-17b9206ab64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fe5a5e9fcb4fc7a47807e754d95b70, user_id=8156242719464c85ae77a332fe5d5eb2, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:44.974130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba022f-9423-4c33-a2b7-17b9206ab64f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:45.090504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 632/1271] 10.222.0.31 () {58 vars in 1460 bytes} [Sat Feb 12 04:02:44 2022] PUT /identity/v3/projects/46fe5a5e9fcb4fc7a47807e754d95b70/users/8156242719464c85ae77a332fe5d5eb2/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:02:47.277786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb77e6-2b10-47ae-b718-a880a585114e None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.278300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb77e6-2b10-47ae-b718-a880a585114e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.278410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb77e6-2b10-47ae-b718-a880a585114e None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.280100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 640/1272] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:47.285486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bb59-85c0-4eae-99ac-b63f7ee5de36 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.285890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bb59-85c0-4eae-99ac-b63f7ee5de36 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.286041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9bb59-85c0-4eae-99ac-b63f7ee5de36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.303740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e2d9bb59-85c0-4eae-99ac-b63f7ee5de36 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:47.304915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e2d9bb59-85c0-4eae-99ac-b63f7ee5de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:47.359731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 633/1273] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:47.383459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb77e6-2b10-47ae-b718-a880a585114e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.395445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb77e6-2b10-47ae-b718-a880a585114e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.399772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.400529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.400809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.401084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.411058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:02:47.418273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:02:47.419590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 641/1274] 10.222.0.31 () {56 vars in 1117 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:47.425550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9bb59-85c0-4eae-99ac-b63f7ee5de36 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.435177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9bb59-85c0-4eae-99ac-b63f7ee5de36 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.439826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.440472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.440752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.441025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.441821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:47.442128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.443751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.452349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 634/1275] 10.222.0.31 () {56 vars in 1120 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:47.457831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.468972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385136c8-d248-48eb-b156-19395e28bec7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.473604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.474359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.474639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.474909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.485373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.487213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.503826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:47.504958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 642/1276] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:02:47.510685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.520362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3ac92-c091-4630-8f8b-8346abe7c8df admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.525427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.526062 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.531640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.531640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.531640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:47.531640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.531640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.541420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 635/1277] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:47.546627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.556173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0772406-5d8a-43e4-93de-901f8c95d082 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.560621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.561406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.561694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.561965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.569017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.577573 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.584421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:02:47.585546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 643/1278] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:02:47.591858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.601244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aac0a4-53d5-4057-b9be-c85b272203a4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.606406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.607041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.607319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.607590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.608422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:47.608725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.610581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.626994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 636/1279] 10.222.0.31 () {56 vars in 1164 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:47.632376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.641775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d5d4-8f1b-48da-8e23-2b2c089bbff1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.646301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.646926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.647221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.647489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.656062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.657249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.666003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 644/1280] 10.222.0.31 () {58 vars in 1324 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:02:47.671405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.681375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153a01a-450a-474a-8a04-0e58c5c4b280 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.685853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.686611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.686889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.687163 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.697557 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.699358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.715587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:02:47.716774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 637/1281] 10.222.0.31 () {56 vars in 1129 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:02:47.722276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.731106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42665b7b-b0cb-4439-945d-48bda1971282 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.737113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.737113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.737113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.737113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.737568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:47.737876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.739433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.750819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 645/1282] 10.222.0.31 () {56 vars in 1130 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:47.756129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.766195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6982a-3274-4e9d-b878-bcd5c72a3f4f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.770691 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.772124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.772124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.772124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.778739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.780681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.793465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING keystone.server.flask.application [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:02:47.794530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 638/1283] 10.222.0.31 () {56 vars in 1132 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:47.800669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.811422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4803e1-a9c2-4fc7-931d-e643651df374 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.816000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0b743-160e-46b5-93bc-b233ccb6d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.816630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0b743-160e-46b5-93bc-b233ccb6d3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.816902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0b743-160e-46b5-93bc-b233ccb6d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.817178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0b743-160e-46b5-93bc-b233ccb6d3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.818007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0b743-160e-46b5-93bc-b233ccb6d3f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:47.818317 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0b743-160e-46b5-93bc-b233ccb6d3f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.820139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0b743-160e-46b5-93bc-b233ccb6d3f7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.832669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 646/1284] 10.222.0.31 () {56 vars in 1169 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:47.838986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:47.849187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957ed72-5852-487f-8043-82eaf2df43aa admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:47.854176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3032b-d493-4911-9caf-75499936584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:47.854790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3032b-d493-4911-9caf-75499936584f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:47.855067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3032b-d493-4911-9caf-75499936584f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:47.855338 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3032b-d493-4911-9caf-75499936584f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:47.856207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3032b-d493-4911-9caf-75499936584f admin admin] RBAC: Adding query filter params (role.id=8302aa99fb20433b8a0329ec7c83740c, scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70, user.id=8156242719464c85ae77a332fe5d5eb2) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:47.856511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3032b-d493-4911-9caf-75499936584f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:47.858350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3032b-d493-4911-9caf-75499936584f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:47.863832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 639/1285] 10.222.0.31 () {56 vars in 1395 bytes} [Sat Feb 12 04:02:47 2022] GET /identity/v3/role_assignments?user.id=8156242719464c85ae77a332fe5d5eb2&scope.project.id=46fe5a5e9fcb4fc7a47807e754d95b70&role.id=8302aa99fb20433b8a0329ec7c83740c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:50.050578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8f76-15d4-483e-9125-a59dfa06934a None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:50.051126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8f76-15d4-483e-9125-a59dfa06934a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:50.051126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a8f76-15d4-483e-9125-a59dfa06934a None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:50.052887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 647/1286] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:50.058653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102a6f-75b1-49c2-9809-0a520b1e9f12 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:50.059025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102a6f-75b1-49c2-9809-0a520b1e9f12 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:50.059204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102a6f-75b1-49c2-9809-0a520b1e9f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:50.076894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-7c102a6f-75b1-49c2-9809-0a520b1e9f12 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:50.078099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7c102a6f-75b1-49c2-9809-0a520b1e9f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:50.085628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 640/1287] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:50.108225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a8f76-15d4-483e-9125-a59dfa06934a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:50.120885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a8f76-15d4-483e-9125-a59dfa06934a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:50.125184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:50.125981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:50.126264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:50.126539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:50.127200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:50.128776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:50.139502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 12 04:02:50.140592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 648/1288] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:02:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:50.146378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102a6f-75b1-49c2-9809-0a520b1e9f12 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:50.155252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102a6f-75b1-49c2-9809-0a520b1e9f12 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:50.159826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9677-18ee-4bc3-a998-9f0de67abb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:50.160470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9677-18ee-4bc3-a998-9f0de67abb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:50.160751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9677-18ee-4bc3-a998-9f0de67abb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:50.161028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9677-18ee-4bc3-a998-9f0de67abb53 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:50.161783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f9677-18ee-4bc3-a998-9f0de67abb53 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:50.162091 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f9677-18ee-4bc3-a998-9f0de67abb53 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:50.163697 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f9677-18ee-4bc3-a998-9f0de67abb53 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:50.168957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 641/1289] 10.222.0.31 () {56 vars in 1137 bytes} [Sat Feb 12 04:02:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:50.174419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:50.184399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c5ade-a5d7-4e42-a661-4f9d60c09847 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:50.188941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c81e86-c7d3-427b-a6c1-99b08fe98c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:50.189592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c81e86-c7d3-427b-a6c1-99b08fe98c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:50.189872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c81e86-c7d3-427b-a6c1-99b08fe98c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:50.190144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c81e86-c7d3-427b-a6c1-99b08fe98c81 admin admin] PATH_INFO: `/v3/services` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:50.190845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c81e86-c7d3-427b-a6c1-99b08fe98c81 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:50.191145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c81e86-c7d3-427b-a6c1-99b08fe98c81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:50.192764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c81e86-c7d3-427b-a6c1-99b08fe98c81 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:50.196976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 649/1290] 10.222.0.31 () {56 vars in 1137 bytes} [Sat Feb 12 04:02:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:52.371242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4061f-1d92-45a2-a2eb-17a1f9b0654c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:52.371759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4061f-1d92-45a2-a2eb-17a1f9b0654c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:52.371847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4061f-1d92-45a2-a2eb-17a1f9b0654c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:52.373573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 642/1291] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:02:52.378973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fb94-9b93-4911-9cfc-485aa544bc44 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:52.379383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fb94-9b93-4911-9cfc-485aa544bc44 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:52.379548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fb94-9b93-4911-9cfc-485aa544bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:52.396873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c786fb94-9b93-4911-9cfc-485aa544bc44 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:52.398081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c786fb94-9b93-4911-9cfc-485aa544bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:52.405857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 650/1292] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:02:52.428843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4061f-1d92-45a2-a2eb-17a1f9b0654c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:52.441469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4061f-1d92-45a2-a2eb-17a1f9b0654c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:52.445807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fddd2-412f-4182-95eb-2b52e48401a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:52.446461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fddd2-412f-4182-95eb-2b52e48401a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:52.446741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fddd2-412f-4182-95eb-2b52e48401a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:52.447014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fddd2-412f-4182-95eb-2b52e48401a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:52.447746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fddd2-412f-4182-95eb-2b52e48401a5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:52.449354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fddd2-412f-4182-95eb-2b52e48401a5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:52.542951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 643/1293] 10.222.0.31 () {60 vars in 1162 bytes} [Sat Feb 12 04:02:52 2022] POST /identity/v3/services => generated 246 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:02:54.725804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d727-7ec5-4915-8e7d-e9a3b0d8cb3e None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:54.726353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d727-7ec5-4915-8e7d-e9a3b0d8cb3e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:54.726448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d727-7ec5-4915-8e7d-e9a3b0d8cb3e None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:54.728643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 651/1294] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:54.733854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30402fa-05fe-4b74-9429-6b7497d6b6d7 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:54.734298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30402fa-05fe-4b74-9429-6b7497d6b6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:54.734411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30402fa-05fe-4b74-9429-6b7497d6b6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:54.752314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a30402fa-05fe-4b74-9429-6b7497d6b6d7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:54.753549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a30402fa-05fe-4b74-9429-6b7497d6b6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:54.769623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 644/1295] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:54 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:02:54.792300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d727-7ec5-4915-8e7d-e9a3b0d8cb3e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:54.804359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d727-7ec5-4915-8e7d-e9a3b0d8cb3e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:54.809210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:54.809983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:54.810261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:54.810567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:54.811222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:54.812787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:54.823709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 12 04:02:54.824790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 652/1296] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:02:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:54.830545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30402fa-05fe-4b74-9429-6b7497d6b6d7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:54.839513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30402fa-05fe-4b74-9429-6b7497d6b6d7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:54.844123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:54.844763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:54.845039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:54.845341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:54.846059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:54.846362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:54.847946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:54.853638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 645/1297] 10.222.0.31 () {56 vars in 1137 bytes} [Sat Feb 12 04:02:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:54.859506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:54.871807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e81c3-1c6e-47b5-bd34-6bca03413524 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:54.878310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635d92b-0a03-432b-941d-318692619377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:54.879084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d92b-0a03-432b-941d-318692619377 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:54.879589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d92b-0a03-432b-941d-318692619377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:54.879943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d92b-0a03-432b-941d-318692619377 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:54.880756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635d92b-0a03-432b-941d-318692619377 admin admin] RBAC: Adding query filter params (interface=public, service_id=8dc445aa8aff47f49fea2146a74dbbc7, region_id=RegionOne) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:54.881068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635d92b-0a03-432b-941d-318692619377 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:54.882921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635d92b-0a03-432b-941d-318692619377 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:54.887972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 653/1298] 10.222.0.31 () {56 vars in 1272 bytes} [Sat Feb 12 04:02:54 2022] GET /identity/v3/endpoints?service_id=8dc445aa8aff47f49fea2146a74dbbc7&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:02:54.893557 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:54.903187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a1a0b-8f24-458a-b61b-8169dd685579 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:54.908017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaa8e9-2589-411b-a946-fac9bec0d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:54.913745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaa8e9-2589-411b-a946-fac9bec0d3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:54.913745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaa8e9-2589-411b-a946-fac9bec0d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:54.913745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaa8e9-2589-411b-a946-fac9bec0d3f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:54.913745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaa8e9-2589-411b-a946-fac9bec0d3f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:54.913745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaa8e9-2589-411b-a946-fac9bec0d3f8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:54.918875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 646/1299] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:02:54 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:02:57.182658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373e4c9-839d-42ac-99bb-01e81aa35df8 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:57.183226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373e4c9-839d-42ac-99bb-01e81aa35df8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:57.183226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373e4c9-839d-42ac-99bb-01e81aa35df8 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:57.185052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 654/1300] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:02:57.190221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d44a-a81e-4c22-994f-56bbd57d596d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:57.190637 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d44a-a81e-4c22-994f-56bbd57d596d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:57.190771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d44a-a81e-4c22-994f-56bbd57d596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:57.208646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f581d44a-a81e-4c22-994f-56bbd57d596d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:02:57.210015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f581d44a-a81e-4c22-994f-56bbd57d596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:02:57.217890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 647/1301] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:02:57 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:02:57.241448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373e4c9-839d-42ac-99bb-01e81aa35df8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:57.254151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373e4c9-839d-42ac-99bb-01e81aa35df8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:57.259012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:57.259776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:57.260063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:57.260344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:57.261008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:57.262638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:57.273494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING keystone.server.flask.application [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 12 04:02:57.275141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 655/1302] 10.222.0.31 () {56 vars in 1138 bytes} [Sat Feb 12 04:02:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:02:57.281123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d44a-a81e-4c22-994f-56bbd57d596d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:57.291034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d44a-a81e-4c22-994f-56bbd57d596d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:57.295646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfa0f9-02c3-4c8b-9b28-72706d59a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:57.296291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfa0f9-02c3-4c8b-9b28-72706d59a77f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:57.296573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfa0f9-02c3-4c8b-9b28-72706d59a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:57.296842 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfa0f9-02c3-4c8b-9b28-72706d59a77f admin admin] PATH_INFO: `/v3/services` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:57.297585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfa0f9-02c3-4c8b-9b28-72706d59a77f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:02:57.297886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfa0f9-02c3-4c8b-9b28-72706d59a77f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:57.299462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfa0f9-02c3-4c8b-9b28-72706d59a77f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:57.304455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 648/1303] 10.222.0.31 () {56 vars in 1137 bytes} [Sat Feb 12 04:02:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:02:57.312609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:02:57.321906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07e816-5ffd-4bbb-b983-d767617fa9df admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:02:57.326398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e151ce-56cc-4c7c-973a-f14ee8fd1380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:02:57.327020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e151ce-56cc-4c7c-973a-f14ee8fd1380 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:02:57.327299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e151ce-56cc-4c7c-973a-f14ee8fd1380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:02:57.327571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e151ce-56cc-4c7c-973a-f14ee8fd1380 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:02:57.328320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e151ce-56cc-4c7c-973a-f14ee8fd1380 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:02:57.329912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e151ce-56cc-4c7c-973a-f14ee8fd1380 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:02:57.423027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 656/1304] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 04:02:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:10:39.588570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499df4-ffec-451d-a1c6-adbf7396a75e None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:39.589521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499df4-ffec-451d-a1c6-adbf7396a75e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:39.589962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499df4-ffec-451d-a1c6-adbf7396a75e None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:39.598345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a367a1-a0d2-4fbd-b163-3c24a9c81fa2 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:39.606789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a367a1-a0d2-4fbd-b163-3c24a9c81fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:39.606789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a367a1-a0d2-4fbd-b163-3c24a9c81fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:39.607249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 649/1305] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:10:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:39.717996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-63a367a1-a0d2-4fbd-b163-3c24a9c81fa2 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:39.719276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-63a367a1-a0d2-4fbd-b163-3c24a9c81fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:39.878495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 657/1306] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:10:39.908895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499df4-ffec-451d-a1c6-adbf7396a75e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:10:39.910960 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3e499df4-ffec-451d-a1c6-adbf7396a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:40.159875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499df4-ffec-451d-a1c6-adbf7396a75e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:10:40.282797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ec01-23df-4cad-8f6c-840a8dcf579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:10:40.285536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ec01-23df-4cad-8f6c-840a8dcf579b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:40.285737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ec01-23df-4cad-8f6c-840a8dcf579b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:40.285944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ec01-23df-4cad-8f6c-840a8dcf579b admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:40.286704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54ec01-23df-4cad-8f6c-840a8dcf579b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:10:40.288588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54ec01-23df-4cad-8f6c-840a8dcf579b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:10:40.333826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 650/1307] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:10:39 2022] GET /identity/v3/projects => generated 2553 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:10:42.655500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588442-30bd-461e-8397-99a8324d55bc None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:42.656032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588442-30bd-461e-8397-99a8324d55bc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:42.656032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e588442-30bd-461e-8397-99a8324d55bc None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:42.657861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 658/1308] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:42.663044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a36e9-35e3-4a3f-8d3b-1b9b86fa0027 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:42.663463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a36e9-35e3-4a3f-8d3b-1b9b86fa0027 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:42.663600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a36e9-35e3-4a3f-8d3b-1b9b86fa0027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:42.747212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-876a36e9-35e3-4a3f-8d3b-1b9b86fa0027 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:42.748412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-876a36e9-35e3-4a3f-8d3b-1b9b86fa0027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:42.842394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 651/1309] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:10:42.892253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fcc2b-1c1d-4129-80e3-94d0c9d69108 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:42.892651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fcc2b-1c1d-4129-80e3-94d0c9d69108 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:42.892997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fcc2b-1c1d-4129-80e3-94d0c9d69108 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:42.894863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 659/1310] 10.222.0.31 () {54 vars in 964 bytes} [Sat Feb 12 04:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:42.900665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794f3a-93b1-42d7-9003-5dfa2d45a4b9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:42.900953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794f3a-93b1-42d7-9003-5dfa2d45a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:42.901230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794f3a-93b1-42d7-9003-5dfa2d45a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:42.976198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fe794f3a-93b1-42d7-9003-5dfa2d45a4b9 None None] MFA Rules not processed for user `5157463790394bcbae9c0d7e5812f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:42.977334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fe794f3a-93b1-42d7-9003-5dfa2d45a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:43.049770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 652/1311] 10.222.0.31 () {58 vars in 1061 bytes} [Sat Feb 12 04:10:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:10:43.058778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fcc2b-1c1d-4129-80e3-94d0c9d69108 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:10:43.060935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-708fcc2b-1c1d-4129-80e3-94d0c9d69108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:43.159609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fcc2b-1c1d-4129-80e3-94d0c9d69108 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:10:43.238110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582e224-83ab-4f9f-9526-220d65f61d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:10:43.238760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582e224-83ab-4f9f-9526-220d65f61d82 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:43.239039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582e224-83ab-4f9f-9526-220d65f61d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:43.239313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582e224-83ab-4f9f-9526-220d65f61d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:43.241122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f582e224-83ab-4f9f-9526-220d65f61d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:43.353439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582e224-83ab-4f9f-9526-220d65f61d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:10:43.354897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582e224-83ab-4f9f-9526-220d65f61d82 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:10:43.373341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 660/1312] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:10:45.879902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b223a6-430b-44ce-bfb1-75be85225a10 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:45.880339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b223a6-430b-44ce-bfb1-75be85225a10 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:45.880446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b223a6-430b-44ce-bfb1-75be85225a10 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:45.882262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 653/1313] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:45.887657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14753526-1d9e-46aa-b20c-ba3fabfec424 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:45.888060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14753526-1d9e-46aa-b20c-ba3fabfec424 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:45.888215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14753526-1d9e-46aa-b20c-ba3fabfec424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:45.950372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-14753526-1d9e-46aa-b20c-ba3fabfec424 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:45.951543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-14753526-1d9e-46aa-b20c-ba3fabfec424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:46.044293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 661/1314] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:10:46.082420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b223a6-430b-44ce-bfb1-75be85225a10 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:10:46.083920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-27b223a6-430b-44ce-bfb1-75be85225a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:46.182053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b223a6-430b-44ce-bfb1-75be85225a10 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:10:46.250244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17a5e-6e2f-4ec5-8053-e16144f0fa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:10:46.250867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17a5e-6e2f-4ec5-8053-e16144f0fa60 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:46.251145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17a5e-6e2f-4ec5-8053-e16144f0fa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:46.251415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17a5e-6e2f-4ec5-8053-e16144f0fa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:46.252998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-65a17a5e-6e2f-4ec5-8053-e16144f0fa60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:46.355689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17a5e-6e2f-4ec5-8053-e16144f0fa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:10:46.357731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17a5e-6e2f-4ec5-8053-e16144f0fa60 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:10:46.374699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 654/1315] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:10:49.141020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6634b8c-d836-4b31-aaa3-dcb5d4072aed None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:49.141629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6634b8c-d836-4b31-aaa3-dcb5d4072aed None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:49.141629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6634b8c-d836-4b31-aaa3-dcb5d4072aed None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:49.143381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 662/1316] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:49.148586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94a536-1ff8-4be9-9e42-c3fac3e5d124 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:49.149001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94a536-1ff8-4be9-9e42-c3fac3e5d124 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:49.149137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94a536-1ff8-4be9-9e42-c3fac3e5d124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:49.212119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8b94a536-1ff8-4be9-9e42-c3fac3e5d124 None None] MFA Rules not processed for user `ec47112f539d4d568cb96bfb22dd7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:49.213324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8b94a536-1ff8-4be9-9e42-c3fac3e5d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:49.305467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 655/1317] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:10:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:10:49.345604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6634b8c-d836-4b31-aaa3-dcb5d4072aed None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:10:49.347408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c6634b8c-d836-4b31-aaa3-dcb5d4072aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:49.447247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6634b8c-d836-4b31-aaa3-dcb5d4072aed None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:10:49.516432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76bb6d-78be-4927-8b3f-eea93ccac57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:10:49.517062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76bb6d-78be-4927-8b3f-eea93ccac57c service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:49.517370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76bb6d-78be-4927-8b3f-eea93ccac57c service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:49.517646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76bb6d-78be-4927-8b3f-eea93ccac57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:49.519297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5d76bb6d-78be-4927-8b3f-eea93ccac57c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:49.621691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76bb6d-78be-4927-8b3f-eea93ccac57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:10:49.623126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76bb6d-78be-4927-8b3f-eea93ccac57c service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:10:49.640418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 663/1318] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:10:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:10:52.676909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93746-7c92-4594-a3b2-a15a2939f933 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:52.677463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93746-7c92-4594-a3b2-a15a2939f933 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:52.677463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93746-7c92-4594-a3b2-a15a2939f933 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:52.679251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 656/1319] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:52.684545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f52f-16bd-49c0-bbf5-248bbc72042a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:52.684988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f52f-16bd-49c0-bbf5-248bbc72042a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:52.685111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1f52f-16bd-49c0-bbf5-248bbc72042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:52.747821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-cbd1f52f-16bd-49c0-bbf5-248bbc72042a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:52.749014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-cbd1f52f-16bd-49c0-bbf5-248bbc72042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:52.840406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 664/1320] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:10:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:10:52.895126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5dab-caad-4f24-a001-fe7da6478cae None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:52.895410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5dab-caad-4f24-a001-fe7da6478cae None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:52.895686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d5dab-caad-4f24-a001-fe7da6478cae None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:52.897484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 657/1321] 10.222.0.31 () {54 vars in 964 bytes} [Sat Feb 12 04:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:52.903513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d40ad-a25d-4edc-bc84-c0dbed0751f1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:52.903800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d40ad-a25d-4edc-bc84-c0dbed0751f1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:52.904078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d40ad-a25d-4edc-bc84-c0dbed0751f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:52.976128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-431d40ad-a25d-4edc-bc84-c0dbed0751f1 None None] MFA Rules not processed for user `5157463790394bcbae9c0d7e5812f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:52.977236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-431d40ad-a25d-4edc-bc84-c0dbed0751f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:53.049496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 665/1322] 10.222.0.31 () {58 vars in 1061 bytes} [Sat Feb 12 04:10:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:10:53.058551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5dab-caad-4f24-a001-fe7da6478cae None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:10:53.060591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1d6d5dab-caad-4f24-a001-fe7da6478cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:53.157999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d5dab-caad-4f24-a001-fe7da6478cae None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:10:53.226006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b68fec-7471-4487-8088-a80558ae2024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:10:53.226683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b68fec-7471-4487-8088-a80558ae2024 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:53.226909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b68fec-7471-4487-8088-a80558ae2024 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:53.227180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b68fec-7471-4487-8088-a80558ae2024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:53.228779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-13b68fec-7471-4487-8088-a80558ae2024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:53.331232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b68fec-7471-4487-8088-a80558ae2024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:10:53.332765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b68fec-7471-4487-8088-a80558ae2024 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:10:53.350696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 658/1323] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:10:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:10:56.993157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a4f8-b1f2-420e-a1ab-8d4d84f7fa13 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:56.993742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a4f8-b1f2-420e-a1ab-8d4d84f7fa13 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:56.993742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0a4f8-b1f2-420e-a1ab-8d4d84f7fa13 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:56.995556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 666/1324] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:57.001402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4f921-1a4a-453f-a22c-de7119920378 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:57.001803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4f921-1a4a-453f-a22c-de7119920378 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:57.001951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4f921-1a4a-453f-a22c-de7119920378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:57.063366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-5de4f921-1a4a-453f-a22c-de7119920378 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:57.064542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5de4f921-1a4a-453f-a22c-de7119920378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:57.156242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 659/1325] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:10:57.193243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0a4f8-b1f2-420e-a1ab-8d4d84f7fa13 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:10:57.194774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e8e0a4f8-b1f2-420e-a1ab-8d4d84f7fa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:57.295392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0a4f8-b1f2-420e-a1ab-8d4d84f7fa13 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:10:57.365170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc48e9-ad53-4b80-b128-4fb3e76bccbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:10:57.365905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc48e9-ad53-4b80-b128-4fb3e76bccbb service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:57.366187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc48e9-ad53-4b80-b128-4fb3e76bccbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:57.366462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc48e9-ad53-4b80-b128-4fb3e76bccbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:57.368092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d7cc48e9-ad53-4b80-b128-4fb3e76bccbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:57.471691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc48e9-ad53-4b80-b128-4fb3e76bccbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:10:57.473115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc48e9-ad53-4b80-b128-4fb3e76bccbb service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:10:57.490938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 667/1326] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:10:59.776212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d53eca-12dd-4af3-a5b0-67ebf8259974 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:59.776843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d53eca-12dd-4af3-a5b0-67ebf8259974 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:59.776843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d53eca-12dd-4af3-a5b0-67ebf8259974 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:59.778564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 660/1327] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:10:59.784275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a884b3-cf24-4249-a608-c37774bcbbf3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:10:59.784751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a884b3-cf24-4249-a608-c37774bcbbf3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:10:59.784890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a884b3-cf24-4249-a608-c37774bcbbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:10:59.850183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f0a884b3-cf24-4249-a608-c37774bcbbf3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:10:59.851374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f0a884b3-cf24-4249-a608-c37774bcbbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:10:59.945265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 668/1328] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:10:59.981561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d53eca-12dd-4af3-a5b0-67ebf8259974 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:10:59.983111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-51d53eca-12dd-4af3-a5b0-67ebf8259974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:00.086545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d53eca-12dd-4af3-a5b0-67ebf8259974 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:00.156194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df7c2a-4f96-47b8-b858-2ba252eab6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:00.156821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7c2a-4f96-47b8-b858-2ba252eab6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:00.157099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7c2a-4f96-47b8-b858-2ba252eab6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:00.157407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df7c2a-4f96-47b8-b858-2ba252eab6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:00.159032 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-92df7c2a-4f96-47b8-b858-2ba252eab6a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:00.262374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df7c2a-4f96-47b8-b858-2ba252eab6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:00.263807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df7c2a-4f96-47b8-b858-2ba252eab6a3 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:00.281449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 661/1329] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:02.555920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4ff3-661e-4d7b-be61-5dd042763f1b None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:02.556442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4ff3-661e-4d7b-be61-5dd042763f1b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:02.556442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4ff3-661e-4d7b-be61-5dd042763f1b None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:02.558364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 669/1330] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:02.563386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f691-507f-4510-b239-7cfbc82ff0d8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:02.563818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f691-507f-4510-b239-7cfbc82ff0d8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:02.563947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f691-507f-4510-b239-7cfbc82ff0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:02.626830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-5469f691-507f-4510-b239-7cfbc82ff0d8 None None] MFA Rules not processed for user `ec47112f539d4d568cb96bfb22dd7bee`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:02.628009 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5469f691-507f-4510-b239-7cfbc82ff0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:02.723633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 662/1331] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:02.761504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e4ff3-661e-4d7b-be61-5dd042763f1b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:02.763542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-171e4ff3-661e-4d7b-be61-5dd042763f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:02.865323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e4ff3-661e-4d7b-be61-5dd042763f1b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:02.935422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aec1cd-7cca-4e0b-9228-9d47853582ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:02.936056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec1cd-7cca-4e0b-9228-9d47853582ed service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:02.936337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec1cd-7cca-4e0b-9228-9d47853582ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:02.936609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec1cd-7cca-4e0b-9228-9d47853582ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:02.938255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-38aec1cd-7cca-4e0b-9228-9d47853582ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:03.042063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aec1cd-7cca-4e0b-9228-9d47853582ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:03.043496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aec1cd-7cca-4e0b-9228-9d47853582ed service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:03.061836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 670/1332] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:05.749013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47831694-7084-49ea-a254-971674cc329c None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:05.749601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47831694-7084-49ea-a254-971674cc329c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:05.749601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47831694-7084-49ea-a254-971674cc329c None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:05.751381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 663/1333] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:05.756643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbe85-d1ef-41aa-b564-29f679f6819b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:05.757136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbe85-d1ef-41aa-b564-29f679f6819b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:05.757251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbe85-d1ef-41aa-b564-29f679f6819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:05.821918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1bfdbe85-d1ef-41aa-b564-29f679f6819b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:05.823114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1bfdbe85-d1ef-41aa-b564-29f679f6819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:05.945329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 671/1334] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:05.978767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47831694-7084-49ea-a254-971674cc329c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:05.980383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-47831694-7084-49ea-a254-971674cc329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:06.100249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47831694-7084-49ea-a254-971674cc329c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:06.187663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25ef8-bda2-46bd-b05c-94a3299ee339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:06.188344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25ef8-bda2-46bd-b05c-94a3299ee339 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:06.189203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25ef8-bda2-46bd-b05c-94a3299ee339 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:06.189203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25ef8-bda2-46bd-b05c-94a3299ee339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:06.190616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d5d25ef8-bda2-46bd-b05c-94a3299ee339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:06.312433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d25ef8-bda2-46bd-b05c-94a3299ee339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:06.317341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d25ef8-bda2-46bd-b05c-94a3299ee339 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:06.337313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 664/1335] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:08.650508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354a3ba-532d-4966-9622-4365eafd211d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:08.651029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354a3ba-532d-4966-9622-4365eafd211d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:08.651149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354a3ba-532d-4966-9622-4365eafd211d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:08.653446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 672/1336] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:08.658677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0a1e-397b-41ad-a204-8bc3335977a0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:08.659097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0a1e-397b-41ad-a204-8bc3335977a0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:08.659188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0a1e-397b-41ad-a204-8bc3335977a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:08.720793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2a8e0a1e-397b-41ad-a204-8bc3335977a0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:08.722269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2a8e0a1e-397b-41ad-a204-8bc3335977a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:08.813857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 665/1337] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:11:08.854038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354a3ba-532d-4966-9622-4365eafd211d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:08.855608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b354a3ba-532d-4966-9622-4365eafd211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:08.956762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354a3ba-532d-4966-9622-4365eafd211d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:09.025867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71dda-0fd5-4b2a-a71a-d6244e0a2d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:09.026541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71dda-0fd5-4b2a-a71a-d6244e0a2d3b service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:09.026825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71dda-0fd5-4b2a-a71a-d6244e0a2d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:09.027101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71dda-0fd5-4b2a-a71a-d6244e0a2d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:09.028736 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-06b71dda-0fd5-4b2a-a71a-d6244e0a2d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:09.132197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71dda-0fd5-4b2a-a71a-d6244e0a2d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:09.133645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71dda-0fd5-4b2a-a71a-d6244e0a2d3b service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:09.151468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 673/1338] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:11.992226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6f0b-8b9a-4ff1-899e-ea8d5d8f90ce None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:11.992743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6f0b-8b9a-4ff1-899e-ea8d5d8f90ce None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:11.992833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6f0b-8b9a-4ff1-899e-ea8d5d8f90ce None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:11.994635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 666/1339] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:11.999835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d3984-ff4f-43e9-a51e-6a1f161d0a60 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:12.000238 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d3984-ff4f-43e9-a51e-6a1f161d0a60 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:12.000391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d3984-ff4f-43e9-a51e-6a1f161d0a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:12.066716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-859d3984-ff4f-43e9-a51e-6a1f161d0a60 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:12.067923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-859d3984-ff4f-43e9-a51e-6a1f161d0a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:12.167913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 674/1340] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:12.204052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6f0b-8b9a-4ff1-899e-ea8d5d8f90ce None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:12.206162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a71b6f0b-8b9a-4ff1-899e-ea8d5d8f90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:12.295498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6f0b-8b9a-4ff1-899e-ea8d5d8f90ce None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:12.299046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741347e-d1cc-4356-8b33-09bd26fea918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:12.299681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741347e-d1cc-4356-8b33-09bd26fea918 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:12.299964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741347e-d1cc-4356-8b33-09bd26fea918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:12.300236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741347e-d1cc-4356-8b33-09bd26fea918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:12.308791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741347e-d1cc-4356-8b33-09bd26fea918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:12.310250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741347e-d1cc-4356-8b33-09bd26fea918 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:12.319237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 667/1341] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:16.689833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccef55-fbf5-4e20-b9f9-3fb72ddd55b0 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:16.690400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccef55-fbf5-4e20-b9f9-3fb72ddd55b0 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:16.690400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccef55-fbf5-4e20-b9f9-3fb72ddd55b0 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:16.692162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 675/1342] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:16.697354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491d82-de61-4660-a165-e556a2f88d1d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:16.697752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491d82-de61-4660-a165-e556a2f88d1d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:16.697904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac491d82-de61-4660-a165-e556a2f88d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:16.728279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-ac491d82-de61-4660-a165-e556a2f88d1d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:16.732283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ac491d82-de61-4660-a165-e556a2f88d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:16.807379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 668/1343] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:16.847003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccef55-fbf5-4e20-b9f9-3fb72ddd55b0 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:16.857721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccef55-fbf5-4e20-b9f9-3fb72ddd55b0 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:16.861196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bfe85-3411-4863-97fa-9b6fdda33b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:16.861852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfe85-3411-4863-97fa-9b6fdda33b8c service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:16.864694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfe85-3411-4863-97fa-9b6fdda33b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:16.864694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfe85-3411-4863-97fa-9b6fdda33b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:16.871240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bfe85-3411-4863-97fa-9b6fdda33b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:16.872679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bfe85-3411-4863-97fa-9b6fdda33b8c service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:16.881811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 676/1344] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:11:19.968862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0ca1-2b5c-41d1-bf07-96abe486ef3e None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:19.969419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0ca1-2b5c-41d1-bf07-96abe486ef3e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:19.969419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0ca1-2b5c-41d1-bf07-96abe486ef3e None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:19.971118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 669/1345] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:19.976681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77a4a-6d94-43ad-9879-04470ae24d57 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:19.977134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77a4a-6d94-43ad-9879-04470ae24d57 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:19.977258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77a4a-6d94-43ad-9879-04470ae24d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:19.994430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b3e77a4a-6d94-43ad-9879-04470ae24d57 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:19.995599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b3e77a4a-6d94-43ad-9879-04470ae24d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:20.006375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 677/1346] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:20.043976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b0ca1-2b5c-41d1-bf07-96abe486ef3e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:20.054275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b0ca1-2b5c-41d1-bf07-96abe486ef3e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:20.057720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36323e1c-c355-4169-9769-18c0cc194ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:20.058334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36323e1c-c355-4169-9769-18c0cc194ccf service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:20.059172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36323e1c-c355-4169-9769-18c0cc194ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:20.059446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36323e1c-c355-4169-9769-18c0cc194ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:20.067920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36323e1c-c355-4169-9769-18c0cc194ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:20.069367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36323e1c-c355-4169-9769-18c0cc194ccf service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:20.078844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 670/1347] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:24.622459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94a6b-3984-4b22-aadc-0c65264db124 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:24.622987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94a6b-3984-4b22-aadc-0c65264db124 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:24.623095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94a6b-3984-4b22-aadc-0c65264db124 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:24.624793 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 678/1348] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:24.630070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237493-0964-42e7-abeb-fdffe9d4512c None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:24.630459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237493-0964-42e7-abeb-fdffe9d4512c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:24.630629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237493-0964-42e7-abeb-fdffe9d4512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:24.648181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-71237493-0964-42e7-abeb-fdffe9d4512c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:24.649395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-71237493-0964-42e7-abeb-fdffe9d4512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:24.658003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 671/1349] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:24.695671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e94a6b-3984-4b22-aadc-0c65264db124 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:24.706708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e94a6b-3984-4b22-aadc-0c65264db124 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:24.710264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b931d-bcd2-4df6-937b-f1f254c8f454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:24.710957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b931d-bcd2-4df6-937b-f1f254c8f454 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:24.711240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b931d-bcd2-4df6-937b-f1f254c8f454 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:24.711519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b931d-bcd2-4df6-937b-f1f254c8f454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:24.721143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b931d-bcd2-4df6-937b-f1f254c8f454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:24.723055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b931d-bcd2-4df6-937b-f1f254c8f454 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:24.732987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 679/1350] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:29.843241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9af93-7483-42b5-8176-1531d6a052ea None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:29.844042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9af93-7483-42b5-8176-1531d6a052ea None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:29.844473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9af93-7483-42b5-8176-1531d6a052ea None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:29.849790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 672/1351] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:11:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:29.854120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b398-7366-466e-9cc8-d90623e9a06f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:29.854799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b398-7366-466e-9cc8-d90623e9a06f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:29.854799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8b398-7366-466e-9cc8-d90623e9a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:29.946052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2ef8b398-7366-466e-9cc8-d90623e9a06f None None] MFA Rules not processed for user `8156242719464c85ae77a332fe5d5eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:29.947476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2ef8b398-7366-466e-9cc8-d90623e9a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:30.036809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 680/1352] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:34.326493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b807a-0e0b-4473-957e-53635aece116 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:34.327531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b807a-0e0b-4473-957e-53635aece116 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:34.327872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b807a-0e0b-4473-957e-53635aece116 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:34.329749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 673/1353] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:34.334906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec727e5-a3b8-4ca4-b068-663fb9d63703 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:34.335349 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec727e5-a3b8-4ca4-b068-663fb9d63703 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:34.335633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec727e5-a3b8-4ca4-b068-663fb9d63703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:34.354874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3ec727e5-a3b8-4ca4-b068-663fb9d63703 None None] MFA Rules not processed for user `8156242719464c85ae77a332fe5d5eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:34.356134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3ec727e5-a3b8-4ca4-b068-663fb9d63703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:34.364880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 681/1354] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:11:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:35.790006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af3a23-a5f8-43de-be37-cc24b8f6f9cd None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:35.790614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af3a23-a5f8-43de-be37-cc24b8f6f9cd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:35.790614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af3a23-a5f8-43de-be37-cc24b8f6f9cd None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:35.793197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 674/1355] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:35.798690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a43e7-6029-4293-85b5-3ae4dcbb6eb5 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:35.799341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a43e7-6029-4293-85b5-3ae4dcbb6eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:35.799341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a43e7-6029-4293-85b5-3ae4dcbb6eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:35.818455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-406a43e7-6029-4293-85b5-3ae4dcbb6eb5 None None] MFA Rules not processed for user `8156242719464c85ae77a332fe5d5eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:35.819625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-406a43e7-6029-4293-85b5-3ae4dcbb6eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:35.828337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 682/1356] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:11:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:39.642259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48281d-3315-4406-9ef2-f95b0ad6e3f8 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:39.642781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48281d-3315-4406-9ef2-f95b0ad6e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:39.642781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48281d-3315-4406-9ef2-f95b0ad6e3f8 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:39.644446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 675/1357] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:39.649623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce534-38b1-4159-954f-9f3c3faa42f5 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:39.650031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce534-38b1-4159-954f-9f3c3faa42f5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:39.650174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce534-38b1-4159-954f-9f3c3faa42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:39.668921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-19fce534-38b1-4159-954f-9f3c3faa42f5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:39.670125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-19fce534-38b1-4159-954f-9f3c3faa42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:39.679143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 683/1358] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:39.725534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb201f-8ddd-4f38-80b3-49980aabb21a None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:39.725969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb201f-8ddd-4f38-80b3-49980aabb21a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:39.726340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb201f-8ddd-4f38-80b3-49980aabb21a None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:39.728529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 676/1359] 10.222.0.31 () {54 vars in 961 bytes} [Sat Feb 12 04:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:39.733892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6354-50fd-49b7-89e9-300cc92e0c71 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:39.734347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6354-50fd-49b7-89e9-300cc92e0c71 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:39.734622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6354-50fd-49b7-89e9-300cc92e0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:39.783698 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-83cf6354-50fd-49b7-89e9-300cc92e0c71 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:39.785352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-83cf6354-50fd-49b7-89e9-300cc92e0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:39.869099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 684/1360] 10.222.0.31 () {58 vars in 1058 bytes} [Sat Feb 12 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:39.878021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb201f-8ddd-4f38-80b3-49980aabb21a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:39.893362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb201f-8ddd-4f38-80b3-49980aabb21a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:39.899185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d033f-39ae-413d-8a4c-0eaf3a75263c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:39.900073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d033f-39ae-413d-8a4c-0eaf3a75263c service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:39.900572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d033f-39ae-413d-8a4c-0eaf3a75263c service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:39.901047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d033f-39ae-413d-8a4c-0eaf3a75263c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:39.909535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d033f-39ae-413d-8a4c-0eaf3a75263c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:39.911316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d033f-39ae-413d-8a4c-0eaf3a75263c service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:39.922568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 677/1361] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:11:42.366008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2190c-7ea3-4b71-99d4-d6b92078d043 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:42.366543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2190c-7ea3-4b71-99d4-d6b92078d043 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:42.366543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2190c-7ea3-4b71-99d4-d6b92078d043 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:42.369876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 685/1362] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:42.374351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f926a-c716-4c08-adc9-060e77401da9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:42.374760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f926a-c716-4c08-adc9-060e77401da9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:42.374892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f926a-c716-4c08-adc9-060e77401da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:42.392654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6d9f926a-c716-4c08-adc9-060e77401da9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:42.393882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6d9f926a-c716-4c08-adc9-060e77401da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:42.405632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 678/1363] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:42.445722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2190c-7ea3-4b71-99d4-d6b92078d043 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:42.460099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2190c-7ea3-4b71-99d4-d6b92078d043 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:42.465839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be7054-93c4-47ab-8808-1b894a1f6a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:42.466465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7054-93c4-47ab-8808-1b894a1f6a17 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:42.466744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7054-93c4-47ab-8808-1b894a1f6a17 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:42.467014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7054-93c4-47ab-8808-1b894a1f6a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:42.475543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be7054-93c4-47ab-8808-1b894a1f6a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:42.477121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be7054-93c4-47ab-8808-1b894a1f6a17 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:42.490165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 686/1364] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:45.142297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd010d-e93a-4592-8422-9f8c7cdad3da None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:45.142887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd010d-e93a-4592-8422-9f8c7cdad3da None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:45.142887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd010d-e93a-4592-8422-9f8c7cdad3da None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:45.144534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 679/1365] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:45.149815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72646442-e840-41d0-9dcc-38b3dda41f75 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:45.150219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72646442-e840-41d0-9dcc-38b3dda41f75 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:45.150384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72646442-e840-41d0-9dcc-38b3dda41f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:45.168976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-72646442-e840-41d0-9dcc-38b3dda41f75 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:45.170201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-72646442-e840-41d0-9dcc-38b3dda41f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:45.177928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 687/1366] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:45.223088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee061-33a7-42d0-8014-72498d5d0d55 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:45.223402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee061-33a7-42d0-8014-72498d5d0d55 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:45.223676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee061-33a7-42d0-8014-72498d5d0d55 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:45.225458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 680/1367] 10.222.0.31 () {54 vars in 961 bytes} [Sat Feb 12 04:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:11:45.230848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26285b68-0297-48b6-9724-2aa107d0f342 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:45.231132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26285b68-0297-48b6-9724-2aa107d0f342 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:45.231409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26285b68-0297-48b6-9724-2aa107d0f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:45.249900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-26285b68-0297-48b6-9724-2aa107d0f342 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:45.251066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-26285b68-0297-48b6-9724-2aa107d0f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:45.260096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 688/1368] 10.222.0.31 () {58 vars in 1058 bytes} [Sat Feb 12 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:11:45.268429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ee061-33a7-42d0-8014-72498d5d0d55 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:45.289724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ee061-33a7-42d0-8014-72498d5d0d55 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:45.295209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec34189-0081-4c53-aabc-6a627273ab6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:45.295910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec34189-0081-4c53-aabc-6a627273ab6f service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:45.296258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec34189-0081-4c53-aabc-6a627273ab6f service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:45.296620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec34189-0081-4c53-aabc-6a627273ab6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:45.304887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec34189-0081-4c53-aabc-6a627273ab6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:45.306580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec34189-0081-4c53-aabc-6a627273ab6f service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:45.315845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 681/1369] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:47.751571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe513d-22d4-453c-b1a4-38c7c9f77e58 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:47.752176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe513d-22d4-453c-b1a4-38c7c9f77e58 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:47.752176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe513d-22d4-453c-b1a4-38c7c9f77e58 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:47.753986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 689/1370] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:47.760043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfef02-1f00-48aa-956a-bb7323448837 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:47.760588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfef02-1f00-48aa-956a-bb7323448837 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:47.760588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfef02-1f00-48aa-956a-bb7323448837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:47.780425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-cabfef02-1f00-48aa-956a-bb7323448837 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:47.781716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cabfef02-1f00-48aa-956a-bb7323448837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:47.782175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66d94-219d-4830-8e47-c535c60dbe7e None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:47.782469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66d94-219d-4830-8e47-c535c60dbe7e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:47.782870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66d94-219d-4830-8e47-c535c60dbe7e None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:47.785124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 690/1371] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:11:47.790083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 682/1372] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:47.791132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f90d1-ce04-4639-a2b6-a1e4545709a2 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:47.791354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f90d1-ce04-4639-a2b6-a1e4545709a2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:47.791633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f90d1-ce04-4639-a2b6-a1e4545709a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:47.809856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-dc8f90d1-ce04-4639-a2b6-a1e4545709a2 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:47.811168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dc8f90d1-ce04-4639-a2b6-a1e4545709a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:47.819122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 691/1373] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:11:47.869206 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfef02-1f00-48aa-956a-bb7323448837 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:47.881739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfef02-1f00-48aa-956a-bb7323448837 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:47.887608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f238-ffcb-4ad9-b65e-ba6be4d92b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:47.888244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f238-ffcb-4ad9-b65e-ba6be4d92b0c service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:47.888522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f238-ffcb-4ad9-b65e-ba6be4d92b0c service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:47.888796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f238-ffcb-4ad9-b65e-ba6be4d92b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:47.897205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f238-ffcb-4ad9-b65e-ba6be4d92b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:47.898815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f238-ffcb-4ad9-b65e-ba6be4d92b0c service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:47.909426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 683/1374] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:48.050320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e7ac-e64d-43a1-9d2e-63accb5a0b50 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:48.050710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e7ac-e64d-43a1-9d2e-63accb5a0b50 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:48.051085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e7ac-e64d-43a1-9d2e-63accb5a0b50 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:48.053529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 692/1375] 10.222.0.31 () {54 vars in 963 bytes} [Sat Feb 12 04:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:48.058421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de3b8c-0f00-4474-8daf-7d06d1e3c4ff None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:48.058709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de3b8c-0f00-4474-8daf-7d06d1e3c4ff None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:48.058985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de3b8c-0f00-4474-8daf-7d06d1e3c4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:48.109566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-58de3b8c-0f00-4474-8daf-7d06d1e3c4ff None None] MFA Rules not processed for user `6ee2e293bd2649f0b6d5aa13dc02ea89`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:48.111070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-58de3b8c-0f00-4474-8daf-7d06d1e3c4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:48.181470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 684/1376] 10.222.0.31 () {58 vars in 1060 bytes} [Sat Feb 12 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:48.190393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e7ac-e64d-43a1-9d2e-63accb5a0b50 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:48.203810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e7ac-e64d-43a1-9d2e-63accb5a0b50 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:48.207944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05ff52-4c3f-4118-8b29-cb1e9000ce6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:48.208813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05ff52-4c3f-4118-8b29-cb1e9000ce6c service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:48.209271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05ff52-4c3f-4118-8b29-cb1e9000ce6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:48.209907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05ff52-4c3f-4118-8b29-cb1e9000ce6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:48.220915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05ff52-4c3f-4118-8b29-cb1e9000ce6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:48.222909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05ff52-4c3f-4118-8b29-cb1e9000ce6c service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:48.234304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 693/1377] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:50.308715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3900c3-0446-4585-88c8-ed77a507288a None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:50.309182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3900c3-0446-4585-88c8-ed77a507288a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:50.309427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3900c3-0446-4585-88c8-ed77a507288a None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:50.311267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 685/1378] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:50.317258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065cf5a-9fef-4737-92ff-dcfc2b709f00 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:50.317661 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065cf5a-9fef-4737-92ff-dcfc2b709f00 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:50.318139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065cf5a-9fef-4737-92ff-dcfc2b709f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:50.336399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3065cf5a-9fef-4737-92ff-dcfc2b709f00 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:50.337671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3065cf5a-9fef-4737-92ff-dcfc2b709f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:50.345502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 694/1379] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:50.392210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3900c3-0446-4585-88c8-ed77a507288a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:50.407668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3900c3-0446-4585-88c8-ed77a507288a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:50.413056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff6310-aa79-46be-bf1d-64c9ce276a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:50.413834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff6310-aa79-46be-bf1d-64c9ce276a42 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:50.414113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff6310-aa79-46be-bf1d-64c9ce276a42 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:50.414388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff6310-aa79-46be-bf1d-64c9ce276a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:50.423152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff6310-aa79-46be-bf1d-64c9ce276a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:50.424734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff6310-aa79-46be-bf1d-64c9ce276a42 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:50.434759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 686/1380] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:52.800162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d68e1-d761-4698-aba2-c87906aee54b None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:52.801219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d68e1-d761-4698-aba2-c87906aee54b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:52.801710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d68e1-d761-4698-aba2-c87906aee54b None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:52.803616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 695/1381] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:52.809483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2bdc4-3965-42f5-9e49-f0df36a921f3 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:52.809914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2bdc4-3965-42f5-9e49-f0df36a921f3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:52.810029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2bdc4-3965-42f5-9e49-f0df36a921f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:52.827998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e9b2bdc4-3965-42f5-9e49-f0df36a921f3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:52.829448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e9b2bdc4-3965-42f5-9e49-f0df36a921f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:52.838071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 687/1382] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:52.882182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d68e1-d761-4698-aba2-c87906aee54b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:52.897422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d68e1-d761-4698-aba2-c87906aee54b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:52.903627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0f4ee-1319-4c4c-94f1-5952b4fb068b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:52.904323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0f4ee-1319-4c4c-94f1-5952b4fb068b service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:52.904678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0f4ee-1319-4c4c-94f1-5952b4fb068b service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:52.905065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0f4ee-1319-4c4c-94f1-5952b4fb068b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:52.913217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0f4ee-1319-4c4c-94f1-5952b4fb068b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:52.915017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0f4ee-1319-4c4c-94f1-5952b4fb068b service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:52.924421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 696/1383] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:11:55.317793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d8078-50dc-4a11-94f5-652f4a14b38d None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:55.318390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d8078-50dc-4a11-94f5-652f4a14b38d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:55.318390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d8078-50dc-4a11-94f5-652f4a14b38d None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:55.323094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 688/1384] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:11:55.326283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4405a-ee9d-422e-bd3e-2b3ec9824fb2 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:55.327148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4405a-ee9d-422e-bd3e-2b3ec9824fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:55.327433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4405a-ee9d-422e-bd3e-2b3ec9824fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:55.345753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-8fa4405a-ee9d-422e-bd3e-2b3ec9824fb2 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:55.346943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8fa4405a-ee9d-422e-bd3e-2b3ec9824fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:55.355549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 697/1385] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:55.396229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d8078-50dc-4a11-94f5-652f4a14b38d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:55.411673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d8078-50dc-4a11-94f5-652f4a14b38d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:55.417200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6fd41-d878-408a-a33e-b3d04b76a3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:55.418377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6fd41-d878-408a-a33e-b3d04b76a3d1 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:55.418659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6fd41-d878-408a-a33e-b3d04b76a3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:55.418933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6fd41-d878-408a-a33e-b3d04b76a3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:55.427245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6fd41-d878-408a-a33e-b3d04b76a3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:55.428830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6fd41-d878-408a-a33e-b3d04b76a3d1 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:55.438203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 689/1386] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:11:57.689653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a6d07-a474-47db-be9b-11dd06773af5 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:57.690187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a6d07-a474-47db-be9b-11dd06773af5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:57.690572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a6d07-a474-47db-be9b-11dd06773af5 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:57.692373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 698/1387] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:11:57.698073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a9cf-2691-4e20-ae1c-c1d9004f7040 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:57.699100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a9cf-2691-4e20-ae1c-c1d9004f7040 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:57.699195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a9cf-2691-4e20-ae1c-c1d9004f7040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:57.724707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-3614a9cf-2691-4e20-ae1c-c1d9004f7040 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:11:57.726993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3614a9cf-2691-4e20-ae1c-c1d9004f7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:11:57.740897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 690/1388] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:11:57.786971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a6d07-a474-47db-be9b-11dd06773af5 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:11:57.801184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a6d07-a474-47db-be9b-11dd06773af5 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:11:57.806686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2dff-9751-4c45-a669-195e1632aff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:11:57.807314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2dff-9751-4c45-a669-195e1632aff7 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:11:57.807596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2dff-9751-4c45-a669-195e1632aff7 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:11:57.808450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2dff-9751-4c45-a669-195e1632aff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:11:57.816761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d2dff-9751-4c45-a669-195e1632aff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:11:57.818374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d2dff-9751-4c45-a669-195e1632aff7 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:11:57.827920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 699/1389] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:00.696738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d929d-f5a1-4c1c-a108-a039899afeb2 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:00.697304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d929d-f5a1-4c1c-a108-a039899afeb2 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:00.697404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d929d-f5a1-4c1c-a108-a039899afeb2 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:00.699986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 691/1390] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:12:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:00.706296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354340-3a5e-42a3-8844-b7c0123ee185 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:00.706838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354340-3a5e-42a3-8844-b7c0123ee185 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:00.706955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63354340-3a5e-42a3-8844-b7c0123ee185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:00.727729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-63354340-3a5e-42a3-8844-b7c0123ee185 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:00.729186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-63354340-3a5e-42a3-8844-b7c0123ee185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:00.740228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 700/1391] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:00.791577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d929d-f5a1-4c1c-a108-a039899afeb2 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:00.809140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d929d-f5a1-4c1c-a108-a039899afeb2 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:00.815262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faff8eb-6f91-4c6a-a8d1-75798631fb34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:00.815906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff8eb-6f91-4c6a-a8d1-75798631fb34 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:00.816190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff8eb-6f91-4c6a-a8d1-75798631fb34 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:00.816473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff8eb-6f91-4c6a-a8d1-75798631fb34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:00.825871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faff8eb-6f91-4c6a-a8d1-75798631fb34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:00.827433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faff8eb-6f91-4c6a-a8d1-75798631fb34 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:00.836890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 692/1392] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:03.685956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31995-464e-4fc4-bc41-10973e45c982 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:03.686945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31995-464e-4fc4-bc41-10973e45c982 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:03.686945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31995-464e-4fc4-bc41-10973e45c982 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:03.688273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 701/1393] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:03.694999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e5bb-93fd-40dd-a9d4-c208d49cade5 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:03.697339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e5bb-93fd-40dd-a9d4-c208d49cade5 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:03.697339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0e5bb-93fd-40dd-a9d4-c208d49cade5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:03.718279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-49d0e5bb-93fd-40dd-a9d4-c208d49cade5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:03.719943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-49d0e5bb-93fd-40dd-a9d4-c208d49cade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:03.730807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 693/1394] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:03.784413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31995-464e-4fc4-bc41-10973e45c982 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:03.800868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31995-464e-4fc4-bc41-10973e45c982 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:03.806146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7d43b-0be7-4677-a206-46e8477e8710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:03.806772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d43b-0be7-4677-a206-46e8477e8710 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:03.807052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d43b-0be7-4677-a206-46e8477e8710 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:03.807326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d43b-0be7-4677-a206-46e8477e8710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:03.815429 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7d43b-0be7-4677-a206-46e8477e8710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:03.817012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7d43b-0be7-4677-a206-46e8477e8710 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:03.826847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 702/1395] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:03.988862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c95ae-9bc1-4992-8fcc-55a4006680b7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:03.989058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c95ae-9bc1-4992-8fcc-55a4006680b7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:03.989356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c95ae-9bc1-4992-8fcc-55a4006680b7 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:03.991132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 694/1396] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:03.996607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1a0-817c-4249-8c38-bbe4788a1e61 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:03.996900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1a0-817c-4249-8c38-bbe4788a1e61 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:03.997184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1a0-817c-4249-8c38-bbe4788a1e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:04.015492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d5d4c1a0-817c-4249-8c38-bbe4788a1e61 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:04.016720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d5d4c1a0-817c-4249-8c38-bbe4788a1e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:04.025186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 703/1397] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:04.083261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff3d78-809f-458f-bf5c-45513a7304e7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:04.083546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff3d78-809f-458f-bf5c-45513a7304e7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:04.083825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff3d78-809f-458f-bf5c-45513a7304e7 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:04.085679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 695/1398] 10.222.0.31 () {54 vars in 962 bytes} [Sat Feb 12 04:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:12:04.092098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505b30-9731-4e74-8ea2-18bad260977b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:04.092578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505b30-9731-4e74-8ea2-18bad260977b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:04.092939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505b30-9731-4e74-8ea2-18bad260977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:04.148621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-66505b30-9731-4e74-8ea2-18bad260977b None None] MFA Rules not processed for user `d5f343848a5b4660bfcfe68795a7fcee`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:04.149884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-66505b30-9731-4e74-8ea2-18bad260977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:04.210225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 704/1399] 10.222.0.31 () {58 vars in 1059 bytes} [Sat Feb 12 04:12:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:04.218432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff3d78-809f-458f-bf5c-45513a7304e7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:04.229101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff3d78-809f-458f-bf5c-45513a7304e7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:04.233840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3c118-0811-4689-8fdb-11a58c4e7a03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:04.234494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c118-0811-4689-8fdb-11a58c4e7a03 service glance] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:04.235513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c118-0811-4689-8fdb-11a58c4e7a03 service glance] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:04.235513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c118-0811-4689-8fdb-11a58c4e7a03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:04.250357 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3c118-0811-4689-8fdb-11a58c4e7a03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:04.251731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3c118-0811-4689-8fdb-11a58c4e7a03 service glance] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:04.262038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 696/1400] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:12:04.862790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca18ee3-072e-414e-9dab-3522c9320e0d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:04.863367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca18ee3-072e-414e-9dab-3522c9320e0d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:04.863621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca18ee3-072e-414e-9dab-3522c9320e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:04.916249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9ca18ee3-072e-414e-9dab-3522c9320e0d None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:04.918209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9ca18ee3-072e-414e-9dab-3522c9320e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:04.987751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 705/1401] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:12:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:05.036815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2de3b-e624-429e-9c64-db05e5acf0e4 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:05.037328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2de3b-e624-429e-9c64-db05e5acf0e4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:05.037525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2de3b-e624-429e-9c64-db05e5acf0e4 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:05.039405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 697/1402] 10.222.0.31 () {54 vars in 942 bytes} [Sat Feb 12 04:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:05.047212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8275-3044-4816-b0df-7acbcf07e735 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:05.047505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8275-3044-4816-b0df-7acbcf07e735 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:05.047784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8275-3044-4816-b0df-7acbcf07e735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:05.099237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-bd8d8275-3044-4816-b0df-7acbcf07e735 None None] MFA Rules not processed for user `2f8eac55c400472296dfec3a113799d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:05.100587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bd8d8275-3044-4816-b0df-7acbcf07e735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:05.187529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 706/1403] 10.222.0.31 () {58 vars in 1039 bytes} [Sat Feb 12 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:12:05.200677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2de3b-e624-429e-9c64-db05e5acf0e4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:05.216633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2de3b-e624-429e-9c64-db05e5acf0e4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:05.221768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc103031-bdff-4326-9a74-02ebb83abdc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:05.222899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc103031-bdff-4326-9a74-02ebb83abdc9 service swift] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:05.223359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc103031-bdff-4326-9a74-02ebb83abdc9 service swift] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:05.223926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc103031-bdff-4326-9a74-02ebb83abdc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:05.233328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc103031-bdff-4326-9a74-02ebb83abdc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:05.235239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc103031-bdff-4326-9a74-02ebb83abdc9 service swift] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:05.243696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 698/1404] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:12:06.216575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f019-fdc3-4d72-b1a6-09b3f13a4bfc None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:06.217071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f019-fdc3-4d72-b1a6-09b3f13a4bfc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:06.217161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f019-fdc3-4d72-b1a6-09b3f13a4bfc None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:06.219320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 707/1405] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:06.225028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70e2f-a314-46a5-91dc-7937d8b5ca93 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:06.225533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70e2f-a314-46a5-91dc-7937d8b5ca93 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:06.225613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70e2f-a314-46a5-91dc-7937d8b5ca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:06.248933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2ed70e2f-a314-46a5-91dc-7937d8b5ca93 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:06.250329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2ed70e2f-a314-46a5-91dc-7937d8b5ca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:06.261324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 699/1406] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:06.303070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f019-fdc3-4d72-b1a6-09b3f13a4bfc None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:06.319453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f019-fdc3-4d72-b1a6-09b3f13a4bfc None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:06.326080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e62fa3-064d-4b21-9cd9-ebb0970cefac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:06.326724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62fa3-064d-4b21-9cd9-ebb0970cefac service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:06.327010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62fa3-064d-4b21-9cd9-ebb0970cefac service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:06.327290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e62fa3-064d-4b21-9cd9-ebb0970cefac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:06.336174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e62fa3-064d-4b21-9cd9-ebb0970cefac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:06.337933 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e62fa3-064d-4b21-9cd9-ebb0970cefac service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:06.349547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 708/1407] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:08.760299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1946a3-026a-4d67-9f6f-3e4030c3fe2f None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:08.760832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1946a3-026a-4d67-9f6f-3e4030c3fe2f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:08.760832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1946a3-026a-4d67-9f6f-3e4030c3fe2f None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:08.763149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 700/1408] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:08.768790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737fe1c-05e6-411e-9ffe-367d7a3f0ae3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:08.769237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737fe1c-05e6-411e-9ffe-367d7a3f0ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:08.769407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737fe1c-05e6-411e-9ffe-367d7a3f0ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:08.793687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3737fe1c-05e6-411e-9ffe-367d7a3f0ae3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:08.795258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3737fe1c-05e6-411e-9ffe-367d7a3f0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:08.804211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 709/1409] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:08.852916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1946a3-026a-4d67-9f6f-3e4030c3fe2f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:08.872388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1946a3-026a-4d67-9f6f-3e4030c3fe2f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:08.877943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704da53-299a-4ca6-973b-bcbdf8398cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:08.881331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704da53-299a-4ca6-973b-bcbdf8398cb0 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:08.881630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704da53-299a-4ca6-973b-bcbdf8398cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:08.881909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704da53-299a-4ca6-973b-bcbdf8398cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:08.892255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704da53-299a-4ca6-973b-bcbdf8398cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:08.894012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704da53-299a-4ca6-973b-bcbdf8398cb0 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:08.905371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 701/1410] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:29.929302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d2b78-9c98-42bb-8d10-82a1ab569bba None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:29.929869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d2b78-9c98-42bb-8d10-82a1ab569bba None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:29.929966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d2b78-9c98-42bb-8d10-82a1ab569bba None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:29.931658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 710/1411] 10.222.0.31 () {54 vars in 918 bytes} [Sat Feb 12 04:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:29.937178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522df566-76fe-40c3-b44a-6b6a1ba8ba9a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:29.937660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522df566-76fe-40c3-b44a-6b6a1ba8ba9a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:29.937824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522df566-76fe-40c3-b44a-6b6a1ba8ba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:29.955659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-522df566-76fe-40c3-b44a-6b6a1ba8ba9a None None] MFA Rules not processed for user `8156242719464c85ae77a332fe5d5eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:29.956835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-522df566-76fe-40c3-b44a-6b6a1ba8ba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:29.965166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 702/1412] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Feb 12 04:12:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:29.979194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e4af-4a60-43ff-84b5-c2b9b858e74d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:29.979505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e4af-4a60-43ff-84b5-c2b9b858e74d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:29.979785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e4af-4a60-43ff-84b5-c2b9b858e74d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:29.981565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 711/1413] 10.222.0.31 () {54 vars in 918 bytes} [Sat Feb 12 04:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:29.986418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb233be-c7b6-492f-bfe7-9b89235d2b09 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:29.986708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb233be-c7b6-492f-bfe7-9b89235d2b09 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:29.986985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb233be-c7b6-492f-bfe7-9b89235d2b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:30.005868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-7bb233be-c7b6-492f-bfe7-9b89235d2b09 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:30.007055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7bb233be-c7b6-492f-bfe7-9b89235d2b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:30.017118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 703/1414] 10.222.0.31 () {58 vars in 1015 bytes} [Sat Feb 12 04:12:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:12:32.739779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b885-485b-48cc-9cc1-389880ef4178 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:32.740342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b885-485b-48cc-9cc1-389880ef4178 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:32.740342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078b885-485b-48cc-9cc1-389880ef4178 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:32.742208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 712/1415] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:32.748049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69791ec-0cbf-4b2e-9573-ec99e49354ac None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:32.748474 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69791ec-0cbf-4b2e-9573-ec99e49354ac None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:32.748591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69791ec-0cbf-4b2e-9573-ec99e49354ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:32.765707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f69791ec-0cbf-4b2e-9573-ec99e49354ac None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:32.766871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f69791ec-0cbf-4b2e-9573-ec99e49354ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:32.774415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 704/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:32.815642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078b885-485b-48cc-9cc1-389880ef4178 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:32.829648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078b885-485b-48cc-9cc1-389880ef4178 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:32.834938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f8e06-7f7d-4bd2-8960-026013d8a829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:32.835599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8e06-7f7d-4bd2-8960-026013d8a829 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:32.835885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8e06-7f7d-4bd2-8960-026013d8a829 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:32.836163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8e06-7f7d-4bd2-8960-026013d8a829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:32.844738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f8e06-7f7d-4bd2-8960-026013d8a829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:32.846334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f8e06-7f7d-4bd2-8960-026013d8a829 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:32.856227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 713/1417] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:34.189946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5008d-6d75-4011-af3d-d0f4127f2bdd None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:34.190470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5008d-6d75-4011-af3d-d0f4127f2bdd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:34.190470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5008d-6d75-4011-af3d-d0f4127f2bdd None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:34.192175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 705/1418] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:34.197012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a49fa2-a91f-4faa-a7d2-644dd42cafd7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:34.197468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a49fa2-a91f-4faa-a7d2-644dd42cafd7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:34.197629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a49fa2-a91f-4faa-a7d2-644dd42cafd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:34.214987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f9a49fa2-a91f-4faa-a7d2-644dd42cafd7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:34.216158 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f9a49fa2-a91f-4faa-a7d2-644dd42cafd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:34.224004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 714/1419] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:34.372537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5008d-6d75-4011-af3d-d0f4127f2bdd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:34.386636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5008d-6d75-4011-af3d-d0f4127f2bdd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:34.391976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466eef-0b61-42de-addf-0f694428a0bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:34.392595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466eef-0b61-42de-addf-0f694428a0bf service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:34.392879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466eef-0b61-42de-addf-0f694428a0bf service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:34.393150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466eef-0b61-42de-addf-0f694428a0bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:34.401597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466eef-0b61-42de-addf-0f694428a0bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:34.403169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466eef-0b61-42de-addf-0f694428a0bf service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:34.412271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 706/1420] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:35.721600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88ad1b-c9e7-4ca9-8194-6ad4b769d3ff None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:35.722165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88ad1b-c9e7-4ca9-8194-6ad4b769d3ff None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:35.722165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88ad1b-c9e7-4ca9-8194-6ad4b769d3ff None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:35.724152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 715/1421] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:12:35.729173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770abf69-dc38-475b-8a55-3c282029f173 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:35.729620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770abf69-dc38-475b-8a55-3c282029f173 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:35.729759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770abf69-dc38-475b-8a55-3c282029f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:35.747308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-770abf69-dc38-475b-8a55-3c282029f173 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:35.748878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-770abf69-dc38-475b-8a55-3c282029f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:35.756332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 707/1422] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:12:35.908438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88ad1b-c9e7-4ca9-8194-6ad4b769d3ff None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:35.922999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88ad1b-c9e7-4ca9-8194-6ad4b769d3ff None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:35.928261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46713391-d5be-481b-8d58-ccc205b4782f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:35.928881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713391-d5be-481b-8d58-ccc205b4782f service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:35.929161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713391-d5be-481b-8d58-ccc205b4782f service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:35.929468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46713391-d5be-481b-8d58-ccc205b4782f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:35.937269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46713391-d5be-481b-8d58-ccc205b4782f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:35.938884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46713391-d5be-481b-8d58-ccc205b4782f service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:35.947900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 716/1423] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:37.260913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac363-bf64-4d4f-af77-6457d435069e None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:37.261481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac363-bf64-4d4f-af77-6457d435069e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:37.261481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac363-bf64-4d4f-af77-6457d435069e None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:37.263269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 708/1424] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:37.268086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2efc-423e-4447-b822-771d407561ad None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:37.268518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2efc-423e-4447-b822-771d407561ad None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:37.268657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2efc-423e-4447-b822-771d407561ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:37.286503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5d3b2efc-423e-4447-b822-771d407561ad None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:37.287706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5d3b2efc-423e-4447-b822-771d407561ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:37.296007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 717/1425] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:37.445683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ac363-bf64-4d4f-af77-6457d435069e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:37.459679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ac363-bf64-4d4f-af77-6457d435069e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:37.465487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4db41-cd96-4ced-819e-64c81f7f5221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:37.466103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4db41-cd96-4ced-819e-64c81f7f5221 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:37.466382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4db41-cd96-4ced-819e-64c81f7f5221 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:37.466655 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4db41-cd96-4ced-819e-64c81f7f5221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:37.474797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4db41-cd96-4ced-819e-64c81f7f5221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:37.476358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4db41-cd96-4ced-819e-64c81f7f5221 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:37.486119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 709/1426] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:38.814836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877f21-e9b9-41af-8bb4-63c21a8529bd None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:38.815373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877f21-e9b9-41af-8bb4-63c21a8529bd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:38.815373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c877f21-e9b9-41af-8bb4-63c21a8529bd None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:38.817170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 718/1427] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:38.822008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676d46-a813-41a5-94af-e42660eddd1a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:38.822410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676d46-a813-41a5-94af-e42660eddd1a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:38.822590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676d46-a813-41a5-94af-e42660eddd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:38.840375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1c676d46-a813-41a5-94af-e42660eddd1a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:38.841594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1c676d46-a813-41a5-94af-e42660eddd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:38.849467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 710/1428] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:12:39.000112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877f21-e9b9-41af-8bb4-63c21a8529bd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:39.018676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c877f21-e9b9-41af-8bb4-63c21a8529bd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:39.024361 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb41bf-9c0f-400c-82fa-a0433472613e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:39.029444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb41bf-9c0f-400c-82fa-a0433472613e service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:39.029444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb41bf-9c0f-400c-82fa-a0433472613e service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:39.029444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb41bf-9c0f-400c-82fa-a0433472613e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:39.034181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb41bf-9c0f-400c-82fa-a0433472613e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:39.035733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb41bf-9c0f-400c-82fa-a0433472613e service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:39.044863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 719/1429] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:40.339741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eacf0-2b3e-4975-9e00-fab56316c46b None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:40.340260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eacf0-2b3e-4975-9e00-fab56316c46b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:40.340365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eacf0-2b3e-4975-9e00-fab56316c46b None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:40.342084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 711/1430] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:40.347076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d371-0c9c-4c6c-9e67-057ba9e28eec None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:40.347516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d371-0c9c-4c6c-9e67-057ba9e28eec None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:40.347613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d371-0c9c-4c6c-9e67-057ba9e28eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:40.366000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d200d371-0c9c-4c6c-9e67-057ba9e28eec None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:40.367210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d200d371-0c9c-4c6c-9e67-057ba9e28eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:40.376015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 720/1431] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:40.529394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eacf0-2b3e-4975-9e00-fab56316c46b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:40.543776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eacf0-2b3e-4975-9e00-fab56316c46b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:40.549165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540c168-93b9-4616-bbd8-88bcaa693d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:40.549828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540c168-93b9-4616-bbd8-88bcaa693d37 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:40.550110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540c168-93b9-4616-bbd8-88bcaa693d37 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:40.550391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540c168-93b9-4616-bbd8-88bcaa693d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:40.558817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540c168-93b9-4616-bbd8-88bcaa693d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:40.560419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540c168-93b9-4616-bbd8-88bcaa693d37 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:40.569513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 712/1432] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:41.873794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674cbf-31d8-4da4-b5ce-c4f5ea6f65c8 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:41.874333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674cbf-31d8-4da4-b5ce-c4f5ea6f65c8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:41.874333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674cbf-31d8-4da4-b5ce-c4f5ea6f65c8 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:41.876114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 721/1433] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:41.881128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb557885-58fc-4c01-ac50-258a40ebd78e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:41.881535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb557885-58fc-4c01-ac50-258a40ebd78e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:41.882288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb557885-58fc-4c01-ac50-258a40ebd78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:41.900126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bb557885-58fc-4c01-ac50-258a40ebd78e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:41.901366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bb557885-58fc-4c01-ac50-258a40ebd78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:41.909040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 713/1434] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:42.060893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674cbf-31d8-4da4-b5ce-c4f5ea6f65c8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:42.075505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674cbf-31d8-4da4-b5ce-c4f5ea6f65c8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:42.080845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91271-ad02-4172-adfa-348e4a98a688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:42.081499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91271-ad02-4172-adfa-348e4a98a688 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:42.081781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91271-ad02-4172-adfa-348e4a98a688 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:42.082055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91271-ad02-4172-adfa-348e4a98a688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:42.089887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91271-ad02-4172-adfa-348e4a98a688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:42.091730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91271-ad02-4172-adfa-348e4a98a688 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:42.104572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 722/1435] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:43.420659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7989b7-6cf2-4071-b25a-068a8c64abd6 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:43.421176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7989b7-6cf2-4071-b25a-068a8c64abd6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:43.421267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7989b7-6cf2-4071-b25a-068a8c64abd6 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:43.423040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 714/1436] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:43.427868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d8755-f66b-4c31-987c-6a4a2a420f06 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:43.428286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d8755-f66b-4c31-987c-6a4a2a420f06 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:43.428422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d8755-f66b-4c31-987c-6a4a2a420f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:43.445836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e45d8755-f66b-4c31-987c-6a4a2a420f06 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:43.447003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e45d8755-f66b-4c31-987c-6a4a2a420f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:43.454665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 723/1437] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:43.603595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7989b7-6cf2-4071-b25a-068a8c64abd6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:43.617924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7989b7-6cf2-4071-b25a-068a8c64abd6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:43.623292 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d5ee4-ffa4-4194-9175-e4679f5e816f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:43.623904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5ee4-ffa4-4194-9175-e4679f5e816f service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:43.624181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5ee4-ffa4-4194-9175-e4679f5e816f service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:43.624453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5ee4-ffa4-4194-9175-e4679f5e816f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:43.632149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d5ee4-ffa4-4194-9175-e4679f5e816f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:43.633743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d5ee4-ffa4-4194-9175-e4679f5e816f service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:43.642675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 715/1438] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:44.912985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8258c-bce1-4d79-8d27-72829830efd4 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:44.913575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8258c-bce1-4d79-8d27-72829830efd4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:44.913575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8258c-bce1-4d79-8d27-72829830efd4 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:44.915319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 724/1439] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:44.920279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f598-ca6d-4bcd-b853-90404470aa3e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:44.920712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f598-ca6d-4bcd-b853-90404470aa3e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:44.920817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f598-ca6d-4bcd-b853-90404470aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:44.939298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8f59f598-ca6d-4bcd-b853-90404470aa3e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:44.940483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8f59f598-ca6d-4bcd-b853-90404470aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:44.948690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 716/1440] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:45.096910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8258c-bce1-4d79-8d27-72829830efd4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:45.111095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8258c-bce1-4d79-8d27-72829830efd4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:45.116396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855e19c-074d-4993-a275-21a4b5a9d7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:45.117021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855e19c-074d-4993-a275-21a4b5a9d7ac service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:45.117331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855e19c-074d-4993-a275-21a4b5a9d7ac service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:45.117610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855e19c-074d-4993-a275-21a4b5a9d7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:45.125951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855e19c-074d-4993-a275-21a4b5a9d7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:45.128996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855e19c-074d-4993-a275-21a4b5a9d7ac service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:45.137047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 725/1441] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:47.239477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1283ca3-c193-4b9d-bbb7-7c8d87176597 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:47.240120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1283ca3-c193-4b9d-bbb7-7c8d87176597 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:47.240120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1283ca3-c193-4b9d-bbb7-7c8d87176597 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:47.241845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 717/1442] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:47.247170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c763-438a-4cfe-b16a-dbeab4040e1c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:47.247620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c763-438a-4cfe-b16a-dbeab4040e1c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:47.247731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33c763-438a-4cfe-b16a-dbeab4040e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:47.265262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9d33c763-438a-4cfe-b16a-dbeab4040e1c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:47.266471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9d33c763-438a-4cfe-b16a-dbeab4040e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:47.274311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 726/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:12:47.313366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1283ca3-c193-4b9d-bbb7-7c8d87176597 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:47.323916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1283ca3-c193-4b9d-bbb7-7c8d87176597 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:47.327415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724337-e8c3-4110-ad36-9dd58c46a34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:47.328036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724337-e8c3-4110-ad36-9dd58c46a34c service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:47.328315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724337-e8c3-4110-ad36-9dd58c46a34c service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:47.328588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724337-e8c3-4110-ad36-9dd58c46a34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:47.337168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1724337-e8c3-4110-ad36-9dd58c46a34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:47.339694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1724337-e8c3-4110-ad36-9dd58c46a34c service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:47.349111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 718/1444] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:49.675568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6513a8-a9ca-4dd1-ba55-1e3258fd0481 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:49.676137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6513a8-a9ca-4dd1-ba55-1e3258fd0481 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:49.676137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6513a8-a9ca-4dd1-ba55-1e3258fd0481 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:49.677948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 727/1445] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:49.683827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dfb17-f1ff-4834-b33c-ca2ca9504c8b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:49.684262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dfb17-f1ff-4834-b33c-ca2ca9504c8b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:49.684373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dfb17-f1ff-4834-b33c-ca2ca9504c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:49.701901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bf9dfb17-f1ff-4834-b33c-ca2ca9504c8b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:49.703095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bf9dfb17-f1ff-4834-b33c-ca2ca9504c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:49.710807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 719/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:49.749030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6513a8-a9ca-4dd1-ba55-1e3258fd0481 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:49.759447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6513a8-a9ca-4dd1-ba55-1e3258fd0481 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:49.762996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fe750-db44-4691-8674-b90fcef4c209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:49.763619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe750-db44-4691-8674-b90fcef4c209 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:49.763897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe750-db44-4691-8674-b90fcef4c209 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:49.764172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe750-db44-4691-8674-b90fcef4c209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:49.772733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fe750-db44-4691-8674-b90fcef4c209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:49.774188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fe750-db44-4691-8674-b90fcef4c209 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:49.783240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 728/1447] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:52.340205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d395b-d1d8-40cd-8968-b1b6df78f8c0 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:52.340731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d395b-d1d8-40cd-8968-b1b6df78f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:52.340731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d395b-d1d8-40cd-8968-b1b6df78f8c0 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:52.342521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 720/1448] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:52.348248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093dd40-734d-4b6a-842a-6fbd793ea098 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:52.348637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093dd40-734d-4b6a-842a-6fbd793ea098 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:52.348800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093dd40-734d-4b6a-842a-6fbd793ea098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:52.366492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b093dd40-734d-4b6a-842a-6fbd793ea098 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:52.367681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b093dd40-734d-4b6a-842a-6fbd793ea098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:52.375972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 729/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:52.414082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d395b-d1d8-40cd-8968-b1b6df78f8c0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:52.424444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d395b-d1d8-40cd-8968-b1b6df78f8c0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:52.427922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13232dd-d321-4488-9cca-370924b34e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:52.428538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13232dd-d321-4488-9cca-370924b34e63 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:52.428815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13232dd-d321-4488-9cca-370924b34e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:52.429087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13232dd-d321-4488-9cca-370924b34e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:52.438295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13232dd-d321-4488-9cca-370924b34e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:52.439705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13232dd-d321-4488-9cca-370924b34e63 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:52.449744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 721/1450] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:54.770788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7a8b-7b67-408b-8353-ca9505fb863e None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:54.771392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7a8b-7b67-408b-8353-ca9505fb863e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:54.771392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7a8b-7b67-408b-8353-ca9505fb863e None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:54.773092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 730/1451] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:54.779018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2afb9-1baa-49d9-af35-dddff85359df None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:54.779451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2afb9-1baa-49d9-af35-dddff85359df None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:54.779578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2afb9-1baa-49d9-af35-dddff85359df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:54.797324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b8f2afb9-1baa-49d9-af35-dddff85359df None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:54.798508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b8f2afb9-1baa-49d9-af35-dddff85359df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:54.806325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 722/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:54.844309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b7a8b-7b67-408b-8353-ca9505fb863e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:54.855637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b7a8b-7b67-408b-8353-ca9505fb863e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:54.859090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98355b-24d6-4705-a6aa-f543447c338c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:54.859707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98355b-24d6-4705-a6aa-f543447c338c service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:54.859984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98355b-24d6-4705-a6aa-f543447c338c service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:54.860254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98355b-24d6-4705-a6aa-f543447c338c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:54.868860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98355b-24d6-4705-a6aa-f543447c338c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:54.870328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98355b-24d6-4705-a6aa-f543447c338c service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:54.879314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 731/1453] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:57.110415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807a276-5b14-419c-a105-985912f48ad7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:57.110978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807a276-5b14-419c-a105-985912f48ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:57.110978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807a276-5b14-419c-a105-985912f48ad7 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:57.112750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 723/1454] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:57.117992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e293-5553-44e3-9889-56bed983660e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:57.118409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e293-5553-44e3-9889-56bed983660e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:57.118549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e293-5553-44e3-9889-56bed983660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:57.136966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a7e6e293-5553-44e3-9889-56bed983660e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:57.138254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a7e6e293-5553-44e3-9889-56bed983660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:57.146045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 732/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:57.184078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807a276-5b14-419c-a105-985912f48ad7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:57.194459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807a276-5b14-419c-a105-985912f48ad7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:57.197956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5f7ab-2388-468c-a527-3d6ecf03ef58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:57.198573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f7ab-2388-468c-a527-3d6ecf03ef58 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:57.198854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f7ab-2388-468c-a527-3d6ecf03ef58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:57.199127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f7ab-2388-468c-a527-3d6ecf03ef58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:57.207843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5f7ab-2388-468c-a527-3d6ecf03ef58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:57.209256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5f7ab-2388-468c-a527-3d6ecf03ef58 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:57.218446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 724/1456] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:12:59.451192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74388-1748-46a0-bb52-525ce6c218e1 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:59.451745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74388-1748-46a0-bb52-525ce6c218e1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:59.451745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a74388-1748-46a0-bb52-525ce6c218e1 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:59.453565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 733/1457] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:12:59.459175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a8980-a2b0-422c-8b17-48db178e7557 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:59.459617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a8980-a2b0-422c-8b17-48db178e7557 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:59.459721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a8980-a2b0-422c-8b17-48db178e7557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:59.477887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2f0a8980-a2b0-422c-8b17-48db178e7557 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:12:59.479647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2f0a8980-a2b0-422c-8b17-48db178e7557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:12:59.487321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 725/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:12:59.525412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74388-1748-46a0-bb52-525ce6c218e1 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:12:59.535818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a74388-1748-46a0-bb52-525ce6c218e1 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:12:59.539389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946c56e-7d37-42e9-bb98-7c2dc6c915b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:12:59.540008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946c56e-7d37-42e9-bb98-7c2dc6c915b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:12:59.544724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946c56e-7d37-42e9-bb98-7c2dc6c915b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:12:59.544724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946c56e-7d37-42e9-bb98-7c2dc6c915b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:12:59.549835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946c56e-7d37-42e9-bb98-7c2dc6c915b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:12:59.551249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946c56e-7d37-42e9-bb98-7c2dc6c915b8 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:12:59.561101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 734/1459] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:01.800895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6a005-5a9b-4972-8bdc-92b93b89d86d None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:01.801481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6a005-5a9b-4972-8bdc-92b93b89d86d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:01.801481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6a005-5a9b-4972-8bdc-92b93b89d86d None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:01.803249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 726/1460] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:01.808662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576fc4c-c575-48e6-a23b-cd280107f918 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:01.809064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576fc4c-c575-48e6-a23b-cd280107f918 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:01.809218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576fc4c-c575-48e6-a23b-cd280107f918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:01.827314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d576fc4c-c575-48e6-a23b-cd280107f918 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:01.828483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d576fc4c-c575-48e6-a23b-cd280107f918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:01.836028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 735/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:01.872940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6a005-5a9b-4972-8bdc-92b93b89d86d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:01.883271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6a005-5a9b-4972-8bdc-92b93b89d86d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:01.887483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691837f-0b36-489b-aa05-4ad351fe2e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:01.888116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691837f-0b36-489b-aa05-4ad351fe2e01 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:01.888397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691837f-0b36-489b-aa05-4ad351fe2e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:01.888672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691837f-0b36-489b-aa05-4ad351fe2e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:01.897578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691837f-0b36-489b-aa05-4ad351fe2e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:01.899011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691837f-0b36-489b-aa05-4ad351fe2e01 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:01.908753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 727/1462] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:04.227643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef89837-9909-4bd3-9608-d89d775fb5f1 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:04.228153 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef89837-9909-4bd3-9608-d89d775fb5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:04.228153 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef89837-9909-4bd3-9608-d89d775fb5f1 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:04.230677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 736/1463] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:04.235795 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faf362-44c0-4b2e-bb1b-e56f0c55645e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:04.236209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faf362-44c0-4b2e-bb1b-e56f0c55645e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:04.236344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faf362-44c0-4b2e-bb1b-e56f0c55645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:04.254249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-95faf362-44c0-4b2e-bb1b-e56f0c55645e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:04.255430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-95faf362-44c0-4b2e-bb1b-e56f0c55645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:04.263075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 728/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:04.299891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef89837-9909-4bd3-9608-d89d775fb5f1 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:04.301569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-fef89837-9909-4bd3-9608-d89d775fb5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:04.314694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef89837-9909-4bd3-9608-d89d775fb5f1 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:04.318199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4e95-091e-4077-981d-51262e848359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:04.318821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4e95-091e-4077-981d-51262e848359 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:04.319100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4e95-091e-4077-981d-51262e848359 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:04.319372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4e95-091e-4077-981d-51262e848359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:04.328186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e4e95-091e-4077-981d-51262e848359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:04.329652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e4e95-091e-4077-981d-51262e848359 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:04.339655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 737/1465] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:06.618073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b1e7-57db-4623-b84e-42bbb9cbea6e None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:06.618662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b1e7-57db-4623-b84e-42bbb9cbea6e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:06.618662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6b1e7-57db-4623-b84e-42bbb9cbea6e None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:06.620457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 729/1466] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:06.625840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391e702-0fd2-4d84-b4c4-8af8399693e1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:06.626256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391e702-0fd2-4d84-b4c4-8af8399693e1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:06.626406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391e702-0fd2-4d84-b4c4-8af8399693e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:06.643731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f391e702-0fd2-4d84-b4c4-8af8399693e1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:06.644921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f391e702-0fd2-4d84-b4c4-8af8399693e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:06.653115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 738/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:06.689577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b1e7-57db-4623-b84e-42bbb9cbea6e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:06.700141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6b1e7-57db-4623-b84e-42bbb9cbea6e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:06.703714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aff4e-f0e8-48a3-bafb-d8bb6ed3f81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:06.704340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aff4e-f0e8-48a3-bafb-d8bb6ed3f81b service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:06.704620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aff4e-f0e8-48a3-bafb-d8bb6ed3f81b service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:06.704890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aff4e-f0e8-48a3-bafb-d8bb6ed3f81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:06.714101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aff4e-f0e8-48a3-bafb-d8bb6ed3f81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:06.715525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aff4e-f0e8-48a3-bafb-d8bb6ed3f81b service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:06.724919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 730/1468] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:08.971729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d8e7-1a88-4d55-b33c-0d40b86851fa None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:08.972304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d8e7-1a88-4d55-b33c-0d40b86851fa None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:08.972304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d8e7-1a88-4d55-b33c-0d40b86851fa None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:08.974347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 739/1469] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:08.979765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e19040-f49f-46d4-8978-6afe30d59d10 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:08.980215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e19040-f49f-46d4-8978-6afe30d59d10 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:08.980352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e19040-f49f-46d4-8978-6afe30d59d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:08.998304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-31e19040-f49f-46d4-8978-6afe30d59d10 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:08.999488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-31e19040-f49f-46d4-8978-6afe30d59d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:09.007220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 731/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:09.044240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9d8e7-1a88-4d55-b33c-0d40b86851fa None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:09.055484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9d8e7-1a88-4d55-b33c-0d40b86851fa None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:09.059547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce48ba9-9b91-4d1d-9572-e11039c5a18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:09.064587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce48ba9-9b91-4d1d-9572-e11039c5a18d service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:09.064587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce48ba9-9b91-4d1d-9572-e11039c5a18d service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:09.064587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce48ba9-9b91-4d1d-9572-e11039c5a18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:09.069773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce48ba9-9b91-4d1d-9572-e11039c5a18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:09.071194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce48ba9-9b91-4d1d-9572-e11039c5a18d service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:09.080921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 740/1471] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:25.218504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad015-f6c4-480b-a571-5adcc67e7132 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:25.219108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad015-f6c4-480b-a571-5adcc67e7132 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:25.219108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fad015-f6c4-480b-a571-5adcc67e7132 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:25.220894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 732/1472] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:25.226387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002044c-9e55-4b54-8526-da9bedaae4db None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:25.226817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002044c-9e55-4b54-8526-da9bedaae4db None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:25.226948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002044c-9e55-4b54-8526-da9bedaae4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:25.244568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5002044c-9e55-4b54-8526-da9bedaae4db None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:25.245781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5002044c-9e55-4b54-8526-da9bedaae4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:25.253347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 741/1473] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:25.303402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee7b4-07a0-45ff-9422-e369f21186f3 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:25.303693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee7b4-07a0-45ff-9422-e369f21186f3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:25.303976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee7b4-07a0-45ff-9422-e369f21186f3 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:25.305775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 733/1474] 10.222.0.31 () {54 vars in 962 bytes} [Sat Feb 12 04:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:25.311123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11232a-10ed-40d0-8377-26ba0ddb3fd4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:25.311416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11232a-10ed-40d0-8377-26ba0ddb3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:25.311695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11232a-10ed-40d0-8377-26ba0ddb3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:25.329940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6a11232a-10ed-40d0-8377-26ba0ddb3fd4 None None] MFA Rules not processed for user `d5f343848a5b4660bfcfe68795a7fcee`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:25.331112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6a11232a-10ed-40d0-8377-26ba0ddb3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:25.337402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 742/1475] 10.222.0.31 () {58 vars in 1059 bytes} [Sat Feb 12 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:25.344276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee7b4-07a0-45ff-9422-e369f21186f3 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:25.354831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee7b4-07a0-45ff-9422-e369f21186f3 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:25.358364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc40d5-7977-4477-ad3a-6ffef6d1c947 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:25.358978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc40d5-7977-4477-ad3a-6ffef6d1c947 service glance] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:25.359261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc40d5-7977-4477-ad3a-6ffef6d1c947 service glance] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:25.359537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc40d5-7977-4477-ad3a-6ffef6d1c947 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:25.368198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc40d5-7977-4477-ad3a-6ffef6d1c947 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:25.370155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc40d5-7977-4477-ad3a-6ffef6d1c947 service glance] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:25.379288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 734/1476] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:13:27.668526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8865c-50c2-4ec2-b059-36ce86215d5d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:27.669101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8865c-50c2-4ec2-b059-36ce86215d5d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:27.669101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8865c-50c2-4ec2-b059-36ce86215d5d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:27.670888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 743/1477] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:27.676316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3788a-8e29-4381-8210-875d73abedc1 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:27.676742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3788a-8e29-4381-8210-875d73abedc1 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:27.676852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3788a-8e29-4381-8210-875d73abedc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:27.694819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9af3788a-8e29-4381-8210-875d73abedc1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:27.696037 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9af3788a-8e29-4381-8210-875d73abedc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:27.704287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 735/1478] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:27.727428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8865c-50c2-4ec2-b059-36ce86215d5d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:27.739434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8865c-50c2-4ec2-b059-36ce86215d5d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:27.744281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8799cc-75ec-4e2a-9d5e-da85f3686e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:27.744897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8799cc-75ec-4e2a-9d5e-da85f3686e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:27.745176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8799cc-75ec-4e2a-9d5e-da85f3686e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:27.745477 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8799cc-75ec-4e2a-9d5e-da85f3686e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:27.746205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8799cc-75ec-4e2a-9d5e-da85f3686e80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:27.748015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8799cc-75ec-4e2a-9d5e-da85f3686e80 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:27.766719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 744/1479] 10.222.0.31 () {56 vars in 1108 bytes} [Sat Feb 12 04:13:27 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:13:30.040937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f53334-dd6d-49aa-99d1-7b0c90989802 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:30.041512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f53334-dd6d-49aa-99d1-7b0c90989802 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:30.041615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f53334-dd6d-49aa-99d1-7b0c90989802 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:30.043345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 736/1480] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:30.048907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3bb8d-cc0e-4e90-bd73-909b5c2d876d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:30.049341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3bb8d-cc0e-4e90-bd73-909b5c2d876d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:30.049508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3bb8d-cc0e-4e90-bd73-909b5c2d876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:30.067837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-57f3bb8d-cc0e-4e90-bd73-909b5c2d876d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:30.070885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-57f3bb8d-cc0e-4e90-bd73-909b5c2d876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:30.077043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 745/1481] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:30.119171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f53334-dd6d-49aa-99d1-7b0c90989802 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:30.132940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f53334-dd6d-49aa-99d1-7b0c90989802 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:30.138282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff23e3-621f-4c0f-b22d-54fb24c9f83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:30.138895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff23e3-621f-4c0f-b22d-54fb24c9f83e service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:30.139173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff23e3-621f-4c0f-b22d-54fb24c9f83e service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:30.139439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff23e3-621f-4c0f-b22d-54fb24c9f83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:30.147159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff23e3-621f-4c0f-b22d-54fb24c9f83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:30.148738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff23e3-621f-4c0f-b22d-54fb24c9f83e service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:30.158290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 737/1482] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:32.539891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26416-e33b-471c-a444-cb83a07a6081 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:32.540931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26416-e33b-471c-a444-cb83a07a6081 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:32.540931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be26416-e33b-471c-a444-cb83a07a6081 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:32.542734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 746/1483] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:32.548049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129975a-1e27-4093-809b-84b5c32a22e0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:32.548447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129975a-1e27-4093-809b-84b5c32a22e0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:32.548601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129975a-1e27-4093-809b-84b5c32a22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:32.567503 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f129975a-1e27-4093-809b-84b5c32a22e0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:32.568693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f129975a-1e27-4093-809b-84b5c32a22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:32.576599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 738/1484] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:32.611957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be26416-e33b-471c-a444-cb83a07a6081 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:32.622803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be26416-e33b-471c-a444-cb83a07a6081 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:32.626254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbfef5-5269-4be1-9859-10d6bb1e2ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:32.626871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbfef5-5269-4be1-9859-10d6bb1e2ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:32.627149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbfef5-5269-4be1-9859-10d6bb1e2ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:32.627422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbfef5-5269-4be1-9859-10d6bb1e2ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:32.635896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbfef5-5269-4be1-9859-10d6bb1e2ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:32.637336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbfef5-5269-4be1-9859-10d6bb1e2ab5 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:32.646263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 747/1485] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:34.968477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f4c4-7683-4891-b076-d0d06f751199 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:34.969017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f4c4-7683-4891-b076-d0d06f751199 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:34.969017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f4c4-7683-4891-b076-d0d06f751199 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:34.970818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 739/1486] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:34.976302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92c3e9-cb08-49f9-a858-8c042bc687b1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:34.976745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92c3e9-cb08-49f9-a858-8c042bc687b1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:34.976876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92c3e9-cb08-49f9-a858-8c042bc687b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:34.995440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1b92c3e9-cb08-49f9-a858-8c042bc687b1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:34.996637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1b92c3e9-cb08-49f9-a858-8c042bc687b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:35.004344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 748/1487] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:35.042418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f4c4-7683-4891-b076-d0d06f751199 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:35.052777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f4c4-7683-4891-b076-d0d06f751199 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:35.058148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61476007-5528-4246-9ec9-726cc395a348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:35.058778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476007-5528-4246-9ec9-726cc395a348 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:35.059058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476007-5528-4246-9ec9-726cc395a348 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:35.059354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476007-5528-4246-9ec9-726cc395a348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:35.068365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61476007-5528-4246-9ec9-726cc395a348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:35.069834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61476007-5528-4246-9ec9-726cc395a348 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:35.078968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 740/1488] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:37.448472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8202-697d-4cd0-bf0c-7c32f2241e75 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:37.449006 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8202-697d-4cd0-bf0c-7c32f2241e75 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:37.449169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8202-697d-4cd0-bf0c-7c32f2241e75 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:37.450982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 749/1489] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:13:37.456320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ca64-2c46-470b-858e-2d037299ea79 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:37.456785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ca64-2c46-470b-858e-2d037299ea79 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:37.456895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ca64-2c46-470b-858e-2d037299ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:37.474994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-0650ca64-2c46-470b-858e-2d037299ea79 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:37.476160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0650ca64-2c46-470b-858e-2d037299ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:37.484585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 741/1490] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:37.523696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8202-697d-4cd0-bf0c-7c32f2241e75 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:37.534654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8202-697d-4cd0-bf0c-7c32f2241e75 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:37.538063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618099cf-416b-427b-a23e-e886092b05dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:37.538686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618099cf-416b-427b-a23e-e886092b05dc service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:37.538966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618099cf-416b-427b-a23e-e886092b05dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:37.539241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618099cf-416b-427b-a23e-e886092b05dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:37.548288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618099cf-416b-427b-a23e-e886092b05dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:37.549760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618099cf-416b-427b-a23e-e886092b05dc service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:37.558772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 750/1491] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:13:40.197876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f86b-7c4b-4fd4-b764-8baa1dc22e94 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:40.198401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f86b-7c4b-4fd4-b764-8baa1dc22e94 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:40.198401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7f86b-7c4b-4fd4-b764-8baa1dc22e94 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:40.200099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 742/1492] 10.222.0.31 () {54 vars in 926 bytes} [Sat Feb 12 04:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:13:40.205591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4883-0fcb-45e5-8a98-59bfa76f8a7e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:40.205998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4883-0fcb-45e5-8a98-59bfa76f8a7e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:40.206156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4883-0fcb-45e5-8a98-59bfa76f8a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:40.225430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-304a4883-0fcb-45e5-8a98-59bfa76f8a7e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:13:40.226623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-304a4883-0fcb-45e5-8a98-59bfa76f8a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:13:40.234358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 751/1493] 10.222.0.31 () {58 vars in 1023 bytes} [Sat Feb 12 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:13:40.272789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f86b-7c4b-4fd4-b764-8baa1dc22e94 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:13:40.284198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7f86b-7c4b-4fd4-b764-8baa1dc22e94 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:13:40.287540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06855c-be94-47cd-9b65-83f03651c6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:13:40.288191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06855c-be94-47cd-9b65-83f03651c6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:13:40.288469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06855c-be94-47cd-9b65-83f03651c6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:13:40.288741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06855c-be94-47cd-9b65-83f03651c6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:13:40.297515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06855c-be94-47cd-9b65-83f03651c6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:13:40.298944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06855c-be94-47cd-9b65-83f03651c6d4 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:13:40.308569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 743/1494] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:15:26.578489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918851a0-d826-45b5-8f55-a285899a2bc0 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:26.579052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918851a0-d826-45b5-8f55-a285899a2bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:26.579052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918851a0-d826-45b5-8f55-a285899a2bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:26.597167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-918851a0-d826-45b5-8f55-a285899a2bc0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:26.598370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-918851a0-d826-45b5-8f55-a285899a2bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:26.606363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 752/1495] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:15:26.614146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97189797-286f-4e58-b515-afaa09688cad None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:26.614629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97189797-286f-4e58-b515-afaa09688cad None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:26.614734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97189797-286f-4e58-b515-afaa09688cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:26.631865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-97189797-286f-4e58-b515-afaa09688cad None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:26.633569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-97189797-286f-4e58-b515-afaa09688cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:26.641229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 744/1496] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:15:26.645511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918851a0-d826-45b5-8f55-a285899a2bc0 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:26.655282 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918851a0-d826-45b5-8f55-a285899a2bc0 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:26.659653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:26.660285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:26.660562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:26.660834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:26.661593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:26.661893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:26.663463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:26.674332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 753/1497] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:26.682001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97189797-286f-4e58-b515-afaa09688cad None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:26.690715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97189797-286f-4e58-b515-afaa09688cad None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:26.695143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:26.696264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:26.696542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:26.696810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:26.697530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:26.699405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:26.817441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 745/1498] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:15:26 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:26.822022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:26.831753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dce0bb-3008-47d0-b25a-87d4d079b915 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:26.885614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:26.886263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:26.886542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:26.886816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:26.887504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:26.889423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:26.951861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 754/1499] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:15:26 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:15:26.956105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:26.966498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515d4d6-1dc4-4c67-b772-ec5f92aa380f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:26.971114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:26.971739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:26.972017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:26.972288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:26.973035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:26.974774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:26.987278 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 746/1500] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:15:26.991266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:27.001686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d54a2c-f07c-4d98-8513-9d94f1ee3e0f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:27.006904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45f477-5d73-4317-b709-db40ed1e64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:27.006904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f477-5d73-4317-b709-db40ed1e64dc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.007237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f477-5d73-4317-b709-db40ed1e64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.007439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f477-5d73-4317-b709-db40ed1e64dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.008804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45f477-5d73-4317-b709-db40ed1e64dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:27.010409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45f477-5d73-4317-b709-db40ed1e64dc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:27.023339 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 755/1501] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:15:27.027279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:27.036725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2a10-bc97-45d0-872b-6c772693df6a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:27.041244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:27.042135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.042408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.042680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] PATH_INFO: `/v3/projects/764a7596ef554a348557d392ff143624/users/09d276af085143b3952a660f0613280d/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.061174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764a7596ef554a348557d392ff143624, user_id=09d276af085143b3952a660f0613280d, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:27.061174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:27.146016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 747/1502] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:15:27 2022] PUT /identity/v3/projects/764a7596ef554a348557d392ff143624/users/09d276af085143b3952a660f0613280d/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:15:27.157974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717b0e5-23fb-4ed0-b8f0-c183eb892ee1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.158269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717b0e5-23fb-4ed0-b8f0-c183eb892ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.158585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717b0e5-23fb-4ed0-b8f0-c183eb892ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.184827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-7717b0e5-23fb-4ed0-b8f0-c183eb892ee1 None None] MFA Rules not processed for user `09d276af085143b3952a660f0613280d`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:27.186107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7717b0e5-23fb-4ed0-b8f0-c183eb892ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:27.246101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 756/1503] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:15:27.256880 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:27.323605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d9f86-1b54-4982-964d-fc29e49ead69 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:27.328958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:27.329632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.329913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.330186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.337789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:27.340214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:27.350946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 748/1504] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:15:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:15:27.421682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969d23-b2bc-4e00-9d86-56da1c1d9daf None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.421971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969d23-b2bc-4e00-9d86-56da1c1d9daf None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.422245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969d23-b2bc-4e00-9d86-56da1c1d9daf None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.423950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 757/1505] 10.222.0.31 () {52 vars in 829 bytes} [Sat Feb 12 04:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:27.427416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:27.485157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5c962-9312-46b2-b179-ed0a0bd5ef42 service nova] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:27.489669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:27.490506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.490786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.491058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] PATH_INFO: `/v3/users/09d276af085143b3952a660f0613280d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.492761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d276af085143b3952a660f0613280d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:27.493825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:27.493825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 04:15:27.493825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 04:15:27.495020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:27.734842 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d276af085143b3952a660f0613280d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:27.735492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d276af085143b3952a660f0613280d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:27.811482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d276af085143b3952a660f0613280d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:27.829817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d276af085143b3952a660f0613280d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:27.830466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d276af085143b3952a660f0613280d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:27.847113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 749/1506] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:15:27 2022] DELETE /identity/v3/users/09d276af085143b3952a660f0613280d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:15:27.851879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.852332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.852481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.870787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:27.875270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:27.927732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 758/1507] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:15:27.937862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:27.939243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:27.995831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b49e95-e375-4560-ba26-fee0128ffa63 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:27.999352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37472ce-c023-4531-95ef-a10c59640a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:27.999984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37472ce-c023-4531-95ef-a10c59640a1d service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:28.000264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37472ce-c023-4531-95ef-a10c59640a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:28.000540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37472ce-c023-4531-95ef-a10c59640a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:28.009212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37472ce-c023-4531-95ef-a10c59640a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:28.010663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37472ce-c023-4531-95ef-a10c59640a1d service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:28.019789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 750/1508] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:15:28.498951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:28.500340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:28.515361 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79b2f-8fdc-43e9-b4c8-7aa1196f5948 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:28.517216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:28.518137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:28.518437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:28.518749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] PATH_INFO: `/v3/projects/764a7596ef554a348557d392ff143624` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:28.520720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=764a7596ef554a348557d392ff143624)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:28.522135 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:28.522135 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 04:15:28.522135 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 04:15:28.523341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:28.631424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764a7596ef554a348557d392ff143624', 'request_id': 'req-eb33c525-d018-4553-ac2d-e903bdc0a8ae'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:28.714488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764a7596ef554a348557d392ff143624', 'request_id': 'req-eb33c525-d018-4553-ac2d-e903bdc0a8ae'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:28.720502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764a7596ef554a348557d392ff143624', 'request_id': 'req-eb33c525-d018-4553-ac2d-e903bdc0a8ae'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:28.738460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] The token cache is being invalidate because project 764a7596ef554a348557d392ff143624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:15:28.738746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:28.739455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-eb33c525-d018-4553-ac2d-e903bdc0a8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:15:28.740961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 759/1509] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:15:28 2022] DELETE /identity/v3/projects/764a7596ef554a348557d392ff143624 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:56.022528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2eb16-2c09-4327-88ba-e897f23bdcfb None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.023057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2eb16-2c09-4327-88ba-e897f23bdcfb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.023270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2eb16-2c09-4327-88ba-e897f23bdcfb None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.024901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 751/1510] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:56.029806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb0e6-6662-4459-b302-8a0f7a3fdb69 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.030276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb0e6-6662-4459-b302-8a0f7a3fdb69 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.030382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb0e6-6662-4459-b302-8a0f7a3fdb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.050013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2aecb0e6-6662-4459-b302-8a0f7a3fdb69 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:56.051230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2aecb0e6-6662-4459-b302-8a0f7a3fdb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:56.108650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 760/1511] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:56.243905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1420fe-3694-40a5-9667-edce726440e7 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.244319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1420fe-3694-40a5-9667-edce726440e7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.244682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1420fe-3694-40a5-9667-edce726440e7 None None] PATH_INFO: `/v3` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.246707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 752/1512] 10.222.0.42 () {54 vars in 925 bytes} [Sat Feb 12 04:16:56 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:56.253109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd081-438f-4493-a60f-ee4fc6e6fe69 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.253435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd081-438f-4493-a60f-ee4fc6e6fe69 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.253717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd081-438f-4493-a60f-ee4fc6e6fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.261057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1420fe-3694-40a5-9667-edce726440e7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:56.263502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1f1420fe-3694-40a5-9667-edce726440e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:56.272105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-179bd081-438f-4493-a60f-ee4fc6e6fe69 None None] MFA Rules not processed for user `8156242719464c85ae77a332fe5d5eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:56.273206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-179bd081-438f-4493-a60f-ee4fc6e6fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:56.335100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1420fe-3694-40a5-9667-edce726440e7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:56.336700 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 761/1513] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Feb 12 04:16:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:56.340843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348b17a-809c-4916-a431-04355dc76de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:56.341502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b17a-809c-4916-a431-04355dc76de6 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.341785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b17a-809c-4916-a431-04355dc76de6 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.342056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b17a-809c-4916-a431-04355dc76de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.350371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348b17a-809c-4916-a431-04355dc76de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:56.352210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348b17a-809c-4916-a431-04355dc76de6 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:56.362341 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 753/1514] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:16:57.658438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa96432-5e74-4649-864e-b6001d1c4f43 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.658980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa96432-5e74-4649-864e-b6001d1c4f43 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.658980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa96432-5e74-4649-864e-b6001d1c4f43 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.660774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 762/1515] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:57.665731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9afff-1efe-497a-86d4-4a9df5734268 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.666178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9afff-1efe-497a-86d4-4a9df5734268 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.666275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9afff-1efe-497a-86d4-4a9df5734268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.684355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-3bd9afff-1efe-497a-86d4-4a9df5734268 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:57.685578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3bd9afff-1efe-497a-86d4-4a9df5734268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:57.693207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 754/1516] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:57.844968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa96432-5e74-4649-864e-b6001d1c4f43 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:57.859829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa96432-5e74-4649-864e-b6001d1c4f43 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:57.865210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06896fe-1562-4fbf-899e-39f7a8674249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:57.865864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06896fe-1562-4fbf-899e-39f7a8674249 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.866150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06896fe-1562-4fbf-899e-39f7a8674249 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.866427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06896fe-1562-4fbf-899e-39f7a8674249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.874946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06896fe-1562-4fbf-899e-39f7a8674249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:57.876517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06896fe-1562-4fbf-899e-39f7a8674249 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:57.885707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 763/1517] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:00.360282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244cc7-9333-4e28-89c1-dc1c8e85a6ea None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:00.360751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244cc7-9333-4e28-89c1-dc1c8e85a6ea None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:00.360845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244cc7-9333-4e28-89c1-dc1c8e85a6ea None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:00.362629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 755/1518] 10.222.0.31 () {54 vars in 960 bytes} [Sat Feb 12 04:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:00.367605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be59527-2b08-453f-beaa-ed3fec7014b3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:00.368031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be59527-2b08-453f-beaa-ed3fec7014b3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:00.368159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be59527-2b08-453f-beaa-ed3fec7014b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:00.386808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4be59527-2b08-453f-beaa-ed3fec7014b3 None None] MFA Rules not processed for user `8156242719464c85ae77a332fe5d5eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:00.387996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4be59527-2b08-453f-beaa-ed3fec7014b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:00.396377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 764/1519] 10.222.0.31 () {58 vars in 1057 bytes} [Sat Feb 12 04:17:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:00.403771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6244cc7-9333-4e28-89c1-dc1c8e85a6ea None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:00.416894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6244cc7-9333-4e28-89c1-dc1c8e85a6ea None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:00.421881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299db74-641e-485c-94ff-fbc72b8a881f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:00.422493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299db74-641e-485c-94ff-fbc72b8a881f service placement] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:00.422772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299db74-641e-485c-94ff-fbc72b8a881f service placement] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:00.423046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299db74-641e-485c-94ff-fbc72b8a881f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:00.431286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299db74-641e-485c-94ff-fbc72b8a881f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:00.432938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299db74-641e-485c-94ff-fbc72b8a881f service placement] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:00.442936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 756/1520] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:17:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:09.595672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411b6a-1113-4b06-95e6-e9ff958c3d39 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.596236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411b6a-1113-4b06-95e6-e9ff958c3d39 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.596346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21411b6a-1113-4b06-95e6-e9ff958c3d39 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.598207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 765/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:09.603843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfe117-65d2-4c43-bd38-15eb6c636097 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.604314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfe117-65d2-4c43-bd38-15eb6c636097 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.604408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfe117-65d2-4c43-bd38-15eb6c636097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.623178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e9bfe117-65d2-4c43-bd38-15eb6c636097 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:09.628332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e9bfe117-65d2-4c43-bd38-15eb6c636097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:09.632199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 757/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:09.781447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411b6a-1113-4b06-95e6-e9ff958c3d39 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:09.795459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21411b6a-1113-4b06-95e6-e9ff958c3d39 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:09.801104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aba91-4f6a-4799-8033-c0aaa6addfaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:09.801794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aba91-4f6a-4799-8033-c0aaa6addfaa service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.802094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aba91-4f6a-4799-8033-c0aaa6addfaa service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.802371 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aba91-4f6a-4799-8033-c0aaa6addfaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.810411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aba91-4f6a-4799-8033-c0aaa6addfaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:09.812011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aba91-4f6a-4799-8033-c0aaa6addfaa service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:09.821152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 766/1523] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:11.083522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bf71-3005-4f16-8234-53076c57b7ba None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.084047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bf71-3005-4f16-8234-53076c57b7ba None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.084047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bf71-3005-4f16-8234-53076c57b7ba None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.085882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 758/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:11.090641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6bd26-cf48-4bbb-906d-6664a0a5710f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.091057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6bd26-cf48-4bbb-906d-6664a0a5710f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.091725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6bd26-cf48-4bbb-906d-6664a0a5710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.110083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-90b6bd26-cf48-4bbb-906d-6664a0a5710f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:11.111264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-90b6bd26-cf48-4bbb-906d-6664a0a5710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:11.118893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 767/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:11.269761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3bf71-3005-4f16-8234-53076c57b7ba None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:11.284769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3bf71-3005-4f16-8234-53076c57b7ba None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:11.290204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff462-7f14-4a87-b74e-64fd1558a9bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:11.290832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff462-7f14-4a87-b74e-64fd1558a9bd service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.291114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff462-7f14-4a87-b74e-64fd1558a9bd service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.291389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff462-7f14-4a87-b74e-64fd1558a9bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.299418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff462-7f14-4a87-b74e-64fd1558a9bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:11.300995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff462-7f14-4a87-b74e-64fd1558a9bd service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:11.310240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 759/1526] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:15.465560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01a22f-cc53-4208-9ae9-724b9a445e80 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:15.466122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01a22f-cc53-4208-9ae9-724b9a445e80 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:15.466122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01a22f-cc53-4208-9ae9-724b9a445e80 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:15.467896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 768/1527] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:15.472975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551edb4-1c5b-4770-815e-41671c37fab2 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:15.473423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551edb4-1c5b-4770-815e-41671c37fab2 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:15.473568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551edb4-1c5b-4770-815e-41671c37fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:15.491723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f551edb4-1c5b-4770-815e-41671c37fab2 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:15.492920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f551edb4-1c5b-4770-815e-41671c37fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:15.501228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 760/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:15.537001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01a22f-cc53-4208-9ae9-724b9a445e80 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:15.538600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9a01a22f-cc53-4208-9ae9-724b9a445e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:15.592387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01a22f-cc53-4208-9ae9-724b9a445e80 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:15.595892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61076136-2a25-4a44-9a33-6f4624c87773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:15.596510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076136-2a25-4a44-9a33-6f4624c87773 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:15.596789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076136-2a25-4a44-9a33-6f4624c87773 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:15.597061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076136-2a25-4a44-9a33-6f4624c87773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:15.605902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61076136-2a25-4a44-9a33-6f4624c87773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:15.607342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61076136-2a25-4a44-9a33-6f4624c87773 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:15.616336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 769/1529] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:17.810858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b7df0-2944-42bf-861a-46ae47b90d76 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.811423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b7df0-2944-42bf-861a-46ae47b90d76 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.811423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b7df0-2944-42bf-861a-46ae47b90d76 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.813151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 761/1530] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:17.818528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f524d-8346-4328-8488-969920b3ac6a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.818952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f524d-8346-4328-8488-969920b3ac6a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.819098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f524d-8346-4328-8488-969920b3ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.836764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6f1f524d-8346-4328-8488-969920b3ac6a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:17.838001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6f1f524d-8346-4328-8488-969920b3ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:17.846209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 770/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:17.881413 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b7df0-2944-42bf-861a-46ae47b90d76 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.892128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b7df0-2944-42bf-861a-46ae47b90d76 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.895784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58f626-89cf-4f86-97a7-495b769d1ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.896401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f626-89cf-4f86-97a7-495b769d1ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.896684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f626-89cf-4f86-97a7-495b769d1ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.896960 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f626-89cf-4f86-97a7-495b769d1ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.906295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58f626-89cf-4f86-97a7-495b769d1ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.907727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58f626-89cf-4f86-97a7-495b769d1ce7 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.916948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 762/1532] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:21.742249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b80b80-a74b-4119-a94b-eb55f28bf431 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:21.742788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b80b80-a74b-4119-a94b-eb55f28bf431 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:21.742788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b80b80-a74b-4119-a94b-eb55f28bf431 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:21.744610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 771/1533] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:21.750577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc0420-6246-4f52-8ef9-1299923886cc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:21.751077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc0420-6246-4f52-8ef9-1299923886cc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:21.751282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc0420-6246-4f52-8ef9-1299923886cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:21.768765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9bcc0420-6246-4f52-8ef9-1299923886cc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:21.769999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9bcc0420-6246-4f52-8ef9-1299923886cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:21.777612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 763/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:22.031703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b80b80-a74b-4119-a94b-eb55f28bf431 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:22.033324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c2b80b80-a74b-4119-a94b-eb55f28bf431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:22.088627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b80b80-a74b-4119-a94b-eb55f28bf431 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:22.092763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff8c3-ac21-4f6c-b6f7-13af4b2c5be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:22.093429 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff8c3-ac21-4f6c-b6f7-13af4b2c5be2 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.093714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff8c3-ac21-4f6c-b6f7-13af4b2c5be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.093992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff8c3-ac21-4f6c-b6f7-13af4b2c5be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.103016 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff8c3-ac21-4f6c-b6f7-13af4b2c5be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:22.104430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff8c3-ac21-4f6c-b6f7-13af4b2c5be2 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:22.114134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 772/1535] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:24.376512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f701a5-bb3d-4a7a-9e12-0f2cbe080a57 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:24.377098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f701a5-bb3d-4a7a-9e12-0f2cbe080a57 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:24.377098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f701a5-bb3d-4a7a-9e12-0f2cbe080a57 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:24.378867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 764/1536] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:24.384082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf94f-d783-4e8e-9005-de8abaa133f7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:24.384497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf94f-d783-4e8e-9005-de8abaa133f7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:24.384635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf94f-d783-4e8e-9005-de8abaa133f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:24.402819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f4daf94f-d783-4e8e-9005-de8abaa133f7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:24.403985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f4daf94f-d783-4e8e-9005-de8abaa133f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:24.411902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 773/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:24.660628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430a66-545c-4057-9230-7ec98802d325 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:24.660827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430a66-545c-4057-9230-7ec98802d325 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:24.661101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430a66-545c-4057-9230-7ec98802d325 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:24.662900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 765/1538] 10.222.0.31 () {54 vars in 963 bytes} [Sat Feb 12 04:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:24.667825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69200-b745-4fd0-8c16-473782c20a26 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:24.668105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69200-b745-4fd0-8c16-473782c20a26 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:24.668395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69200-b745-4fd0-8c16-473782c20a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:24.686553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-fba69200-b745-4fd0-8c16-473782c20a26 None None] MFA Rules not processed for user `6ee2e293bd2649f0b6d5aa13dc02ea89`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:24.687744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-fba69200-b745-4fd0-8c16-473782c20a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:24.694109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 774/1539] 10.222.0.31 () {58 vars in 1060 bytes} [Sat Feb 12 04:17:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:24.702112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba430a66-545c-4057-9230-7ec98802d325 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:24.712604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba430a66-545c-4057-9230-7ec98802d325 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:24.716135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf14117-0f8e-48fa-9523-0ec482840381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:24.716748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf14117-0f8e-48fa-9523-0ec482840381 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:24.717030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf14117-0f8e-48fa-9523-0ec482840381 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:24.717335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf14117-0f8e-48fa-9523-0ec482840381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:24.726032 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf14117-0f8e-48fa-9523-0ec482840381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:24.727724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf14117-0f8e-48fa-9523-0ec482840381 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:24.737398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 766/1540] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:48.504025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c0bf-74ae-40b5-a5c0-83cfff630302 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.504622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7061fd-2989-47c5-b13c-82588be88463 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.505016 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c0bf-74ae-40b5-a5c0-83cfff630302 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.505110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7061fd-2989-47c5-b13c-82588be88463 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.505197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c0bf-74ae-40b5-a5c0-83cfff630302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.505301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7061fd-2989-47c5-b13c-82588be88463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.541303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6b62c0bf-74ae-40b5-a5c0-83cfff630302 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.541303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6b62c0bf-74ae-40b5-a5c0-83cfff630302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.543220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bc7061fd-2989-47c5-b13c-82588be88463 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.544637 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bc7061fd-2989-47c5-b13c-82588be88463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.547947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 775/1541] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.557138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8781e-c001-491d-a461-458311653683 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.557549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8781e-c001-491d-a461-458311653683 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.557905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8781e-c001-491d-a461-458311653683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.564773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 767/1542] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.566609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce522e-b24f-4cb3-8b97-cca2c605b4d5 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.567099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce522e-b24f-4cb3-8b97-cca2c605b4d5 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.567575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce522e-b24f-4cb3-8b97-cca2c605b4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.595515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-37d8781e-c001-491d-a461-458311653683 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.595515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-37d8781e-c001-491d-a461-458311653683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.601393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f5ce522e-b24f-4cb3-8b97-cca2c605b4d5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.603575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f5ce522e-b24f-4cb3-8b97-cca2c605b4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.619146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 768/1543] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.619975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 776/1544] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.620467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644610-ba34-4673-9ae7-79d70f40a618 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.620752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644610-ba34-4673-9ae7-79d70f40a618 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.621026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644610-ba34-4673-9ae7-79d70f40a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.622328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21570e2-6341-4605-93c0-e6eddee6fe7a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.622972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21570e2-6341-4605-93c0-e6eddee6fe7a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.623492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21570e2-6341-4605-93c0-e6eddee6fe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.645394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bc644610-ba34-4673-9ae7-79d70f40a618 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.646597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bc644610-ba34-4673-9ae7-79d70f40a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.647083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a21570e2-6341-4605-93c0-e6eddee6fe7a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.648254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a21570e2-6341-4605-93c0-e6eddee6fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.659496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 777/1545] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.659968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 769/1546] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.661710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d915e2-59b4-407e-b7f1-0885eca68f02 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.662235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d915e2-59b4-407e-b7f1-0885eca68f02 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.662740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d915e2-59b4-407e-b7f1-0885eca68f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.664288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ac87-df6e-476a-9234-bea509d1363c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.664556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ac87-df6e-476a-9234-bea509d1363c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.664837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736ac87-df6e-476a-9234-bea509d1363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.683758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-65d915e2-59b4-407e-b7f1-0885eca68f02 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.683989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9736ac87-df6e-476a-9234-bea509d1363c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.685169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9736ac87-df6e-476a-9234-bea509d1363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.685806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-65d915e2-59b4-407e-b7f1-0885eca68f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.693961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 778/1547] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.694890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736ac87-df6e-476a-9234-bea509d1363c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:48.695303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 770/1548] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.697518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea476-0c27-4c20-8618-33e7a77b86fd None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.698044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea476-0c27-4c20-8618-33e7a77b86fd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.698539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea476-0c27-4c20-8618-33e7a77b86fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.713952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736ac87-df6e-476a-9234-bea509d1363c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:48.717951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-019ea476-0c27-4c20-8618-33e7a77b86fd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.719228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f39b18-c90f-4b99-8b90-97e651f89528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:48.719743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-019ea476-0c27-4c20-8618-33e7a77b86fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.719866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f39b18-c90f-4b99-8b90-97e651f89528 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.720155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f39b18-c90f-4b99-8b90-97e651f89528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.720427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f39b18-c90f-4b99-8b90-97e651f89528 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.721164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f39b18-c90f-4b99-8b90-97e651f89528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:48.723133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f39b18-c90f-4b99-8b90-97e651f89528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:48.724714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f39b18-c90f-4b99-8b90-97e651f89528 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:48.733775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 771/1549] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.734874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea476-0c27-4c20-8618-33e7a77b86fd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:48.739604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 779/1550] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:48.745007 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c6f1-423f-4588-9f23-a0153710ff36 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.745328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c6f1-423f-4588-9f23-a0153710ff36 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.745611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085c6f1-423f-4588-9f23-a0153710ff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.748183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea476-0c27-4c20-8618-33e7a77b86fd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:48.753579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:48.754304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.754538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.754815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.755555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:48.755861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:48.757489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:48.764310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e085c6f1-423f-4588-9f23-a0153710ff36 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.765556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e085c6f1-423f-4588-9f23-a0153710ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.776662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 772/1551] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:48.776662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:48.778769 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 780/1552] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.779954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217d4b5-6ecd-4be0-bc97-8620dbbb69f4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.780243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217d4b5-6ecd-4be0-bc97-8620dbbb69f4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.780510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217d4b5-6ecd-4be0-bc97-8620dbbb69f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.786551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783a007-733a-4765-ab0c-da896fc9a92e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:48.791810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1973b-c770-4313-9291-70b9884cda28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:48.792455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1973b-c770-4313-9291-70b9884cda28 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.792740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1973b-c770-4313-9291-70b9884cda28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.793048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1973b-c770-4313-9291-70b9884cda28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.793941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1973b-c770-4313-9291-70b9884cda28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:48.794257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1973b-c770-4313-9291-70b9884cda28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:48.795874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1973b-c770-4313-9291-70b9884cda28 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:48.798824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e217d4b5-6ecd-4be0-bc97-8620dbbb69f4 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.799992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e217d4b5-6ecd-4be0-bc97-8620dbbb69f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.808491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 781/1553] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.808727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 773/1554] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:48.809790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea814-9952-4c7d-92f2-b2b1f4776cf8 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.810077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea814-9952-4c7d-92f2-b2b1f4776cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.810193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3217-7522-42d2-aaab-8cc37b6e7d34 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.810350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea814-9952-4c7d-92f2-b2b1f4776cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.810460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3217-7522-42d2-aaab-8cc37b6e7d34 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.810643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3217-7522-42d2-aaab-8cc37b6e7d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.833425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e12ea814-9952-4c7d-92f2-b2b1f4776cf8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.834162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fe9b3217-7522-42d2-aaab-8cc37b6e7d34 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:48.834605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e12ea814-9952-4c7d-92f2-b2b1f4776cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.835338 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fe9b3217-7522-42d2-aaab-8cc37b6e7d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:48.845246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 774/1555] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.846090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 782/1556] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:48.846293 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b3217-7522-42d2-aaab-8cc37b6e7d34 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:48.846729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea814-9952-4c7d-92f2-b2b1f4776cf8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:48.856044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b3217-7522-42d2-aaab-8cc37b6e7d34 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:48.858778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea814-9952-4c7d-92f2-b2b1f4776cf8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:48.860675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:48.861349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.861636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.861909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.862605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:48.863405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:48.864045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:48.864330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:48.864496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:48.864598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:48.865330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:48.867201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:48.996108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 775/1557] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:48.996108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.013895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 783/1558] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:48 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.014803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.059113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306762-d813-4d7a-a40f-13c5676ca2e0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.072464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c8f0a-0886-4adc-8807-cbdffd6f0eb7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.077067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.077749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.078028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.078300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.079024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:49.079328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.080904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.092868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 784/1559] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:49.093672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.104774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1de0a-3e33-418d-b7d3-03a5b012a34d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.109406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.110025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.110304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.110580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.111264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.113199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.113401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd16b3-7981-4b0a-8f5f-4312c39c943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.114059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd16b3-7981-4b0a-8f5f-4312c39c943c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.114343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd16b3-7981-4b0a-8f5f-4312c39c943c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.115427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd16b3-7981-4b0a-8f5f-4312c39c943c admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.116190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd16b3-7981-4b0a-8f5f-4312c39c943c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:49.116496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd16b3-7981-4b0a-8f5f-4312c39c943c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.118161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd16b3-7981-4b0a-8f5f-4312c39c943c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.129505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 776/1560] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:49.130841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af51990-06c4-4234-a6b0-a643a6298271 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.131126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af51990-06c4-4234-a6b0-a643a6298271 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.131402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af51990-06c4-4234-a6b0-a643a6298271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.149901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9af51990-06c4-4234-a6b0-a643a6298271 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:49.151094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9af51990-06c4-4234-a6b0-a643a6298271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:49.159121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 777/1561] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:49.160302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8eb0a-789b-4274-9861-cea56a91b4a3 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.160582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8eb0a-789b-4274-9861-cea56a91b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.160854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8eb0a-789b-4274-9861-cea56a91b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.177976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-29a8eb0a-789b-4274-9861-cea56a91b4a3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:49.179146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-29a8eb0a-789b-4274-9861-cea56a91b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:49.187434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 778/1562] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:49.188172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8eb0a-789b-4274-9861-cea56a91b4a3 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.197700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8eb0a-789b-4274-9861-cea56a91b4a3 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.202103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.209644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.209644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.209644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.209644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:49.209644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.209644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.210165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 785/1563] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.210165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.217311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 779/1564] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:49.217874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.226939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ac612-0a55-4bcc-9a00-6796a74d1743 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.268247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa7772-bcf9-4d22-8a01-c8421773bd42 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.272788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.273628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.273922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.274205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.274908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.276896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.284097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.284437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.284723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.284997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.285743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.287685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.388500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 786/1565] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.389334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.398756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765a3cb-140f-4629-86c1-aefe85db2a1e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.402757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 780/1566] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.402757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.403612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ec360-5b3d-472d-8c38-296dcd92735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.404251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec360-5b3d-472d-8c38-296dcd92735f admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.404532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec360-5b3d-472d-8c38-296dcd92735f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.404809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec360-5b3d-472d-8c38-296dcd92735f admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.405560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ec360-5b3d-472d-8c38-296dcd92735f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.407449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ec360-5b3d-472d-8c38-296dcd92735f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.409562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f4d16-3f8d-45c4-8f82-ca5ffaec3908 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.413989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.417261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.417261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.417261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.417261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.418006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.500799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 787/1567] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.500799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d037-d835-4adc-b732-b68565e53c9d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.500799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d037-d835-4adc-b732-b68565e53c9d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.500799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d037-d835-4adc-b732-b68565e53c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.517968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-7641d037-d835-4adc-b732-b68565e53c9d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:49.519220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7641d037-d835-4adc-b732-b68565e53c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:49.531780 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 781/1568] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.533144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.576585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 788/1569] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:49.577377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d037-d835-4adc-b732-b68565e53c9d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.586297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d037-d835-4adc-b732-b68565e53c9d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.591127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.591823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.592107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.592383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.593105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.593400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91079e-5fc5-4f18-94b2-ab326ece76fa admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.595091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.598051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.598727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.599007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.599282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.600058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:49.600350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.602785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.614408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 782/1570] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:49.615358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.625194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f000e9-d125-43f4-a0a1-d3807256fa1d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.629764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.630372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.630652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.630924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.631621 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.633538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.701094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 789/1571] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.702121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.711309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc6ed-dd98-4ac1-bbfe-0d507caea6f3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.715868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.716485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.716767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.717044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.717810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.719384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.729599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 790/1572] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:49.730434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.735303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 783/1573] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.735303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.739943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798df874-9f47-4584-9cdf-e7a734c9a4ba admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.793251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec9edb-35fe-4710-822d-c78cda8ce8b8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.795547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.796209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.796493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.796772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.797529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.797768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.798415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.798695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.798966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.799126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.799654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.801615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.809127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 791/1574] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:49.809962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.819300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f8220-60e5-44e0-a602-f7ba83129861 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.824684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.832482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.832482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.832482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.832482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.832482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.941167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 784/1575] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.942176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.951400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6e30a-aa21-4d5c-b4cc-8fee4515fbef admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.955909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.956587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.956867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.957141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.957887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:49.958197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.959782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.965716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 792/1576] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:49.966407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.980122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 785/1577] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:49.980122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:49.980419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c7bf3-b628-47f4-8905-c663f5b04646 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.983239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.983625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ed469-e904-4cd5-bd99-d1ea4199dde1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:49.983890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.984173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.984454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.985297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.987216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:49.988393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:49.988976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:49.989257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:49.989560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:49.990292 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:49.991860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.002462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 786/1578] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.003378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.012593 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cbd18-8c0c-49f1-865c-770ac1745901 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.017162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.017808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.018092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.018368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.019080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.020659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.030527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 787/1579] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.031257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.040741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaa7a0-0c08-487d-b54f-b711bcd85acd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.045225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.045806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.046089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.046368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.047042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.048900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.057592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 793/1580] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:49 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:50.062768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.116056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 788/1581] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:50 2022] POST /identity/v3/users => generated 288 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:50.116056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.118862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4333-c401-4c16-b5a3-3830d9eb52b9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.123077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1723c-2e81-4227-b642-187bcf045a52 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.123556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.124247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.124527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.124823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.125613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.127222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.128130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.128971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.129673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.129954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.130693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.132358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.137241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 794/1582] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.138184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.145329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 789/1583] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.145329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.147918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a0d2-b524-4fda-b4d6-686c99b899e5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.152970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.153127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23de57-c6f6-48eb-a9fd-acbd679da249 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.153633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.153916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.154193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.155044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.156605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.157658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.158264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.158546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.158824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.159508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.161406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.171626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 795/1584] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.172653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.184946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d184db-ed5c-48e3-bfd3-3f5dcc56a94e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.191053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.191704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.192100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.192449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.193186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.195031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.205155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 796/1585] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.205992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.216009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906bbe9-5176-43a9-abb8-109956f8739c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.219002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 790/1586] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:50 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:50.219808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.222630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.223581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.223891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.224171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] PATH_INFO: `/v3/projects/b322dc86ac594838a4aebaf0645d9c21/users/12659c94a0e54cb885e5398cd4ce4469/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.239177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b322dc86ac594838a4aebaf0645d9c21, user_id=12659c94a0e54cb885e5398cd4ce4469, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.241856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.281325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbe4ab-253c-4de6-a16f-61c9f5b82905 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.285983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.286646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.286929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.287207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.287910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.290424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.325103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 797/1587] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:50 2022] PUT /identity/v3/projects/b322dc86ac594838a4aebaf0645d9c21/users/12659c94a0e54cb885e5398cd4ce4469/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:50.326154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.386229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aeb6d-f743-44c9-8d9d-d93d6c90f73a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.390791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.391481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.391762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.392086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.392818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.394449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.403834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 798/1588] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.406388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.406508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 791/1589] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:50 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:50.406508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.416480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d69482-a652-451e-8589-78722b7450bc admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.417054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f266-17cd-43fb-b77b-7c593b60f543 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.421801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.422010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.422443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.422748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.422865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.423022 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.423140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.423420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] PATH_INFO: `/v3/projects/f5a7d98ea94e4547983dbffcb2b614bc/users/86560704b2374f75bc32b19475b63462/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.423756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.425383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.436291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 792/1590] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.437090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.440860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a7d98ea94e4547983dbffcb2b614bc, user_id=86560704b2374f75bc32b19475b63462, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.443536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.448973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323816f-9c0b-4035-9f1b-8a75778931d7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.453741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.454374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.454684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.454957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.455690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.457379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.467626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 793/1591] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.468497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.478313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21de6a-5a81-424a-8cda-78aea5acc981 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.482907 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241f4d2-2981-42e2-8f87-eb918b119b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.483779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f4d2-2981-42e2-8f87-eb918b119b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.484058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f4d2-2981-42e2-8f87-eb918b119b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.484330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241f4d2-2981-42e2-8f87-eb918b119b30 admin admin] PATH_INFO: `/v3/projects/b796ac226697409fbca7f7253ac67292/users/8ad163f747794b6789d79fff4b9c797d/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.498444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241f4d2-2981-42e2-8f87-eb918b119b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b796ac226697409fbca7f7253ac67292, user_id=8ad163f747794b6789d79fff4b9c797d, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.501020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241f4d2-2981-42e2-8f87-eb918b119b30 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.530675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 799/1592] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:50 2022] PUT /identity/v3/projects/f5a7d98ea94e4547983dbffcb2b614bc/users/86560704b2374f75bc32b19475b63462/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:50.531578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.582528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 794/1593] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:50 2022] PUT /identity/v3/projects/b796ac226697409fbca7f7253ac67292/users/8ad163f747794b6789d79fff4b9c797d/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:50.583943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e04f-3e63-461d-b959-2eb1ff4ba746 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.584249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e04f-3e63-461d-b959-2eb1ff4ba746 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.584511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e04f-3e63-461d-b959-2eb1ff4ba746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.590161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40401b7-d2a0-4411-8630-c1ec5332b873 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.612078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8cf3e04f-3e63-461d-b959-2eb1ff4ba746 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:50.613356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8cf3e04f-3e63-461d-b959-2eb1ff4ba746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:50.658002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.658671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.658953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.659231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.659926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.661873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.672294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 795/1594] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:50.673128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3e04f-3e63-461d-b959-2eb1ff4ba746 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.682031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3e04f-3e63-461d-b959-2eb1ff4ba746 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.686702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.687334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.687612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.687902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.688618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.690207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.699931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 796/1595] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.700676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.709698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a5bf7-910e-46f8-b6c3-46d520e1245a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.714707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.715289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.715566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.715852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.716523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.718168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.728175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 797/1596] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:50.728898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.738166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191f7af-22c5-42f9-8423-c68ccb3cbe31 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.743214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d91d2-b676-403d-9da4-b1e1fe3b26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.744109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d91d2-b676-403d-9da4-b1e1fe3b26f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.744329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d91d2-b676-403d-9da4-b1e1fe3b26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.744606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d91d2-b676-403d-9da4-b1e1fe3b26f8 admin admin] PATH_INFO: `/v3/projects/2c6cbd6f5db9481eafeacab911285b1f/users/e45b16b4f82844a0baea20331b44fabd/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.748710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 800/1597] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:50 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:50.749501 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.759526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d91d2-b676-403d-9da4-b1e1fe3b26f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6cbd6f5db9481eafeacab911285b1f, user_id=e45b16b4f82844a0baea20331b44fabd, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.760445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badafab9-5910-490f-b6f1-06e3b72c17bd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.762179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d91d2-b676-403d-9da4-b1e1fe3b26f8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.765043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e1d2f-f5a0-42b7-80bd-01e5125b8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.765959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1d2f-f5a0-42b7-80bd-01e5125b8a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.766235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1d2f-f5a0-42b7-80bd-01e5125b8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.766507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1d2f-f5a0-42b7-80bd-01e5125b8a63 admin admin] PATH_INFO: `/v3/projects/0ca780f7a20a47f881ad0a8588cfae15/users/05caf5a818e049f094f42271993ae3e3/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.781292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e1d2f-f5a0-42b7-80bd-01e5125b8a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca780f7a20a47f881ad0a8588cfae15, user_id=05caf5a818e049f094f42271993ae3e3, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.784032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e1d2f-f5a0-42b7-80bd-01e5125b8a63 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.810468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 798/1598] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:50 2022] PUT /identity/v3/projects/2c6cbd6f5db9481eafeacab911285b1f/users/e45b16b4f82844a0baea20331b44fabd/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:50.811720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.812007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.812285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.830236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 801/1599] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:50 2022] PUT /identity/v3/projects/0ca780f7a20a47f881ad0a8588cfae15/users/05caf5a818e049f094f42271993ae3e3/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:50.830472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:50.831647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:50.832314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da1851-3ecb-4e0e-9ca9-1a977515d6cd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.832854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da1851-3ecb-4e0e-9ca9-1a977515d6cd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.833309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da1851-3ecb-4e0e-9ca9-1a977515d6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.872944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-16da1851-3ecb-4e0e-9ca9-1a977515d6cd None None] MFA Rules not processed for user `8ad163f747794b6789d79fff4b9c797d`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:50.874274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-16da1851-3ecb-4e0e-9ca9-1a977515d6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:50.918532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 799/1600] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:50.919376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.920743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:50.943810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 802/1601] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:50.944733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da1851-3ecb-4e0e-9ca9-1a977515d6cd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:50.958033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da1851-3ecb-4e0e-9ca9-1a977515d6cd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.963160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc93bb1-089d-453d-9f2b-eead58146cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.964031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93bb1-089d-453d-9f2b-eead58146cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.964307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93bb1-089d-453d-9f2b-eead58146cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.964577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93bb1-089d-453d-9f2b-eead58146cd3 admin admin] PATH_INFO: `/v3/projects/e56e0fac86874323b726d0897d3cd6e5/users/19c700111c474ff596979fb4150fa15c/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.976361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0295a-5831-4027-9e06-ccb5c07ed122 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:50.979110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc93bb1-089d-453d-9f2b-eead58146cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56e0fac86874323b726d0897d3cd6e5, user_id=19c700111c474ff596979fb4150fa15c, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.980537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:50.981168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:50.981480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:50.981746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc93bb1-089d-453d-9f2b-eead58146cd3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:50.981851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:50.990583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:50.992012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.001875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 800/1602] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:51.002729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.012367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77559432-5290-48be-aaf3-4d569e570ace service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.018563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.018563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.018563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.018563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.018991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.020658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.030375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 801/1603] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:51.031287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.041227 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4796e-1f01-4771-9023-8fb6f0e12cc6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.047232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 803/1604] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:50 2022] PUT /identity/v3/projects/e56e0fac86874323b726d0897d3cd6e5/users/19c700111c474ff596979fb4150fa15c/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:51.047743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a844-8aa9-4af6-bac7-3419c03e6f58 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.048031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a844-8aa9-4af6-bac7-3419c03e6f58 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.048308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17a844-8aa9-4af6-bac7-3419c03e6f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.075278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-aa17a844-8aa9-4af6-bac7-3419c03e6f58 None None] MFA Rules not processed for user `e45b16b4f82844a0baea20331b44fabd`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:51.076480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-aa17a844-8aa9-4af6-bac7-3419c03e6f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:51.094929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2829863-69f8-4287-b80b-80d0362a8915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.097750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829863-69f8-4287-b80b-80d0362a8915 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.098039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829863-69f8-4287-b80b-80d0362a8915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.098399 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829863-69f8-4287-b80b-80d0362a8915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.099068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2829863-69f8-4287-b80b-80d0362a8915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.100684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2829863-69f8-4287-b80b-80d0362a8915 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.114743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 802/1605] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:51.114743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18e11-0c21-4c23-8110-c13418859039 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.114743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18e11-0c21-4c23-8110-c13418859039 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.114743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d18e11-0c21-4c23-8110-c13418859039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.141715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-38d18e11-0c21-4c23-8110-c13418859039 None None] MFA Rules not processed for user `05caf5a818e049f094f42271993ae3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:51.143064 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-38d18e11-0c21-4c23-8110-c13418859039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:51.145146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 804/1606] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:51.146169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a844-8aa9-4af6-bac7-3419c03e6f58 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.204120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17a844-8aa9-4af6-bac7-3419c03e6f58 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.207714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c367a1-a9ba-465f-820b-3a737e3a4a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.208451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c367a1-a9ba-465f-820b-3a737e3a4a9a service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.208731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c367a1-a9ba-465f-820b-3a737e3a4a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.209015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c367a1-a9ba-465f-820b-3a737e3a4a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.211712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 803/1607] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:51.217811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911007ab-a7dc-455a-b318-71956415cc17 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.225207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911007ab-a7dc-455a-b318-71956415cc17 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.225207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911007ab-a7dc-455a-b318-71956415cc17 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.225473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c367a1-a9ba-465f-820b-3a737e3a4a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.225601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 804/1608] 10.222.0.31 () {54 vars in 961 bytes} [Sat Feb 12 04:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:18:51.225704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c367a1-a9ba-465f-820b-3a737e3a4a9a service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.225802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911007ab-a7dc-455a-b318-71956415cc17 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.232202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 805/1609] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:51.233870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740273a-ff09-4aa0-af29-d39abe5ce71e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.234292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740273a-ff09-4aa0-af29-d39abe5ce71e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.234583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740273a-ff09-4aa0-af29-d39abe5ce71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.236757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911007ab-a7dc-455a-b318-71956415cc17 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.241623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e24286-34f6-4160-9d4a-4e99c33846a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.243062 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e24286-34f6-4160-9d4a-4e99c33846a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.243347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e24286-34f6-4160-9d4a-4e99c33846a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.243620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e24286-34f6-4160-9d4a-4e99c33846a9 admin admin] PATH_INFO: `/v3/projects/fece42b3279f4d4aac21d7922c52c5ed/users/e3609a9d4fe144b68a62ad4696301244/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.252739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3740273a-ff09-4aa0-af29-d39abe5ce71e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:51.253959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3740273a-ff09-4aa0-af29-d39abe5ce71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:51.260961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e24286-34f6-4160-9d4a-4e99c33846a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fece42b3279f4d4aac21d7922c52c5ed, user_id=e3609a9d4fe144b68a62ad4696301244, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.261951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 806/1610] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:51.262749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740273a-ff09-4aa0-af29-d39abe5ce71e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.264197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e24286-34f6-4160-9d4a-4e99c33846a9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.272119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740273a-ff09-4aa0-af29-d39abe5ce71e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.276705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.277384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.277788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.278026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.278764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.280352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.292386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 807/1611] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:51.293272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.305438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a2a1-4af0-4f07-9ada-5f13e1d374b3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.311907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72143037-d903-4ad4-8440-fb6fb8ff3b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.315871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143037-d903-4ad4-8440-fb6fb8ff3b29 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.315871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143037-d903-4ad4-8440-fb6fb8ff3b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.315871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72143037-d903-4ad4-8440-fb6fb8ff3b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.315871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72143037-d903-4ad4-8440-fb6fb8ff3b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.315871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72143037-d903-4ad4-8440-fb6fb8ff3b29 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.365011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 805/1612] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:51 2022] PUT /identity/v3/projects/fece42b3279f4d4aac21d7922c52c5ed/users/e3609a9d4fe144b68a62ad4696301244/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:51.366682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab2e1f-8078-411a-8d07-f85804c410fb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.367065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab2e1f-8078-411a-8d07-f85804c410fb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.367416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab2e1f-8078-411a-8d07-f85804c410fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.389198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-64ab2e1f-8078-411a-8d07-f85804c410fb None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:51.390746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-64ab2e1f-8078-411a-8d07-f85804c410fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:51.411270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 808/1613] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:51.412702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaa36f-9352-48c2-8c5d-149019716990 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.415636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaa36f-9352-48c2-8c5d-149019716990 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.415636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaa36f-9352-48c2-8c5d-149019716990 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.415636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 809/1614] 10.222.0.31 () {54 vars in 961 bytes} [Sat Feb 12 04:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:18:51.416355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaa36f-9352-48c2-8c5d-149019716990 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.472596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 806/1615] 10.222.0.31 () {58 vars in 1058 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:51.473479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab2e1f-8078-411a-8d07-f85804c410fb None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.483671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaa36f-9352-48c2-8c5d-149019716990 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.490354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d5b89-614c-40f5-ad41-7fde03f69d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.490877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d5b89-614c-40f5-ad41-7fde03f69d53 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.491146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d5b89-614c-40f5-ad41-7fde03f69d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.491590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d5b89-614c-40f5-ad41-7fde03f69d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.539060 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab2e1f-8078-411a-8d07-f85804c410fb None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.557179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d5b89-614c-40f5-ad41-7fde03f69d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.558851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d5b89-614c-40f5-ad41-7fde03f69d53 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.569151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 810/1616] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:51.570739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189b5c-d3d7-4e0e-9963-7f063a35ccd3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.571042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189b5c-d3d7-4e0e-9963-7f063a35ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.571325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3189b5c-d3d7-4e0e-9963-7f063a35ccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.592588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a3189b5c-d3d7-4e0e-9963-7f063a35ccd3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:51.594037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a3189b5c-d3d7-4e0e-9963-7f063a35ccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:51.603465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 811/1617] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:51.604117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3189b5c-d3d7-4e0e-9963-7f063a35ccd3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.607237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d14f36-c08b-493b-a392-905e49aeb5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.608726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d14f36-c08b-493b-a392-905e49aeb5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.609313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d14f36-c08b-493b-a392-905e49aeb5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.609779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d14f36-c08b-493b-a392-905e49aeb5f2 admin admin] PATH_INFO: `/v3/projects/f11a00f62cf540c79ea14b02953dfd19/users/c4e830b3807c421e9039bb78a42c393d/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.616333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3189b5c-d3d7-4e0e-9963-7f063a35ccd3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.622220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.623799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.623799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.623799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.624322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.626659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.630230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d14f36-c08b-493b-a392-905e49aeb5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11a00f62cf540c79ea14b02953dfd19, user_id=c4e830b3807c421e9039bb78a42c393d, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.634403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d14f36-c08b-493b-a392-905e49aeb5f2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.712726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 807/1618] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:51 2022] PUT /identity/v3/projects/f11a00f62cf540c79ea14b02953dfd19/users/c4e830b3807c421e9039bb78a42c393d/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:51.712870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 812/1619] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:18:51.712981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c292e-f602-48fa-879e-286cd823eef9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.712981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c292e-f602-48fa-879e-286cd823eef9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.712981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c292e-f602-48fa-879e-286cd823eef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.713343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.730983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9e7c292e-f602-48fa-879e-286cd823eef9 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:51.732233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9e7c292e-f602-48fa-879e-286cd823eef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:51.788709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfad5f0-1a64-462c-9769-055cbf5b1ff8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.800316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 808/1620] 10.222.0.31 () {58 vars in 1058 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:51.801388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c292e-f602-48fa-879e-286cd823eef9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.857536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c292e-f602-48fa-879e-286cd823eef9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.866004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1e354-19ec-4476-b31d-91d33ce04362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.866302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.866666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1e354-19ec-4476-b31d-91d33ce04362 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.866954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1e354-19ec-4476-b31d-91d33ce04362 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.867363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1e354-19ec-4476-b31d-91d33ce04362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.868279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.868703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.869160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.945177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1e354-19ec-4476-b31d-91d33ce04362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.952301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1e354-19ec-4476-b31d-91d33ce04362 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.958068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.960359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:51.964160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 813/1621] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:51.965755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceeca7-40a0-4d9f-9b12-b17efebfee34 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.966045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceeca7-40a0-4d9f-9b12-b17efebfee34 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.966324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceeca7-40a0-4d9f-9b12-b17efebfee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.974973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 809/1622] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:51.975888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:51.989003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-46ceeca7-40a0-4d9f-9b12-b17efebfee34 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:51.989467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb0ffc-544f-4237-b0ac-110588f4ef5c service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:51.993095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-46ceeca7-40a0-4d9f-9b12-b17efebfee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:51.995745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:51.996411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:51.996696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:51.996974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:51.997795 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:51.999525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.003485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 814/1623] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:52.003485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceeca7-40a0-4d9f-9b12-b17efebfee34 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.013540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 810/1624] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:52.014881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.022581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceeca7-40a0-4d9f-9b12-b17efebfee34 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.028282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0487f-e10b-4335-9810-5cc6c5bccf36 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.031156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.033295 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.033423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.033528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.033528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.033792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.034234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.034685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.045306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.049115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.060421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 811/1625] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:52.061340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.071590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2748891-dbae-441b-89d3-8e048fb4096e service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.082361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.084376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.084666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.086988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] PATH_INFO: `/v3/projects/2e5ddf84f48a438da2ef2e961cb1aed1/users/1523aef24eef4d78b642f3be4417488b/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.110327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.113517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.116685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5ddf84f48a438da2ef2e961cb1aed1, user_id=1523aef24eef4d78b642f3be4417488b, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.120631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.143516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 815/1626] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:52.222496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 812/1627] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:52 2022] PUT /identity/v3/projects/2e5ddf84f48a438da2ef2e961cb1aed1/users/1523aef24eef4d78b642f3be4417488b/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:52.228517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.246835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d04ab-86de-4bcb-bac2-48ddee4c164b service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.346476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8369773-d545-4bdb-a9ce-e74ad2e6195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.347333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369773-d545-4bdb-a9ce-e74ad2e6195d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.347627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369773-d545-4bdb-a9ce-e74ad2e6195d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.347908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8369773-d545-4bdb-a9ce-e74ad2e6195d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.348716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8369773-d545-4bdb-a9ce-e74ad2e6195d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.350402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8369773-d545-4bdb-a9ce-e74ad2e6195d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.367867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 816/1628] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:18:52.368280 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.385709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e238d6-7855-4dd6-ba76-5f0d76a1d5c3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.396575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e3521-f7b0-412c-88c6-87121d5a493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.400143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3521-f7b0-412c-88c6-87121d5a493f admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.400443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3521-f7b0-412c-88c6-87121d5a493f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.400726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3521-f7b0-412c-88c6-87121d5a493f admin admin] PATH_INFO: `/v3/projects/2e5ddf84f48a438da2ef2e961cb1aed1/users/1523aef24eef4d78b642f3be4417488b/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.406301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e3521-f7b0-412c-88c6-87121d5a493f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5ddf84f48a438da2ef2e961cb1aed1, user_id=1523aef24eef4d78b642f3be4417488b, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.414168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e3521-f7b0-412c-88c6-87121d5a493f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.433529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c58a5-d703-4b64-a615-c9f829bdae3d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.433824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c58a5-d703-4b64-a615-c9f829bdae3d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.434108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c58a5-d703-4b64-a615-c9f829bdae3d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.436683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 817/1629] 10.222.0.31 () {54 vars in 912 bytes} [Sat Feb 12 04:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:18:52.441415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 813/1630] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:18:52 2022] PUT /identity/v3/projects/2e5ddf84f48a438da2ef2e961cb1aed1/users/1523aef24eef4d78b642f3be4417488b/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:52.443298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3506693-5ae1-4f54-a96b-96486ec1d36b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.443817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3506693-5ae1-4f54-a96b-96486ec1d36b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.444307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3506693-5ae1-4f54-a96b-96486ec1d36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.450182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1b903-1dc9-415b-b823-a024406ba47f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.451879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1b903-1dc9-415b-b823-a024406ba47f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.452231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1b903-1dc9-415b-b823-a024406ba47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.482549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a3506693-5ae1-4f54-a96b-96486ec1d36b None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:52.485217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a3506693-5ae1-4f54-a96b-96486ec1d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:52.489753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-63e1b903-1dc9-415b-b823-a024406ba47f None None] MFA Rules not processed for user `1523aef24eef4d78b642f3be4417488b`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:52.491439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-63e1b903-1dc9-415b-b823-a024406ba47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:52.605197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 818/1631] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:52.607884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d95402-75a2-461a-86b6-51ba578c6cd9 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.608947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d95402-75a2-461a-86b6-51ba578c6cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.609445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d95402-75a2-461a-86b6-51ba578c6cd9 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.613704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 819/1632] 10.222.0.31 () {54 vars in 912 bytes} [Sat Feb 12 04:18:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:18:52.619565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b891-b679-400b-a236-0c405cd32cad None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.620596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b891-b679-400b-a236-0c405cd32cad None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.633492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 814/1633] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:52.633492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1b903-1dc9-415b-b823-a024406ba47f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.634098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b891-b679-400b-a236-0c405cd32cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.653259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f294b891-b679-400b-a236-0c405cd32cad None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:52.654871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f294b891-b679-400b-a236-0c405cd32cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:52.670695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 820/1634] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:52.671807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294b891-b679-400b-a236-0c405cd32cad None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.726463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1b903-1dc9-415b-b823-a024406ba47f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.737171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.737856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.738543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.738543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.755944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.756248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294b891-b679-400b-a236-0c405cd32cad None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.759886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.765352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649528f-a829-49ef-8baa-480348568a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.766321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649528f-a829-49ef-8baa-480348568a60 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.766607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649528f-a829-49ef-8baa-480348568a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.766883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649528f-a829-49ef-8baa-480348568a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.778947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 815/1635] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:52.782114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649528f-a829-49ef-8baa-480348568a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.784828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649528f-a829-49ef-8baa-480348568a60 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:52.797360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 821/1636] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:52.943496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:52.952824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f866881-09e5-43fe-8237-5bf94165994f service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:52.962803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690762f-007e-4e1f-9099-eea823e2b85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:52.963483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690762f-007e-4e1f-9099-eea823e2b85c service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:52.963764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690762f-007e-4e1f-9099-eea823e2b85c service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:52.964051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690762f-007e-4e1f-9099-eea823e2b85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:52.988415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690762f-007e-4e1f-9099-eea823e2b85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:52.989889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690762f-007e-4e1f-9099-eea823e2b85c service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:53.028356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 816/1637] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:54.034474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d169-1941-4c59-8ee3-0c3ed7690e05 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:54.035048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d169-1941-4c59-8ee3-0c3ed7690e05 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:54.035048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16d169-1941-4c59-8ee3-0c3ed7690e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:54.086393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2a16d169-1941-4c59-8ee3-0c3ed7690e05 None None] MFA Rules not processed for user `e3609a9d4fe144b68a62ad4696301244`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:54.097124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2a16d169-1941-4c59-8ee3-0c3ed7690e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:54.234404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8353a4c-412d-47b4-94f5-c992a1e1d678 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:54.234932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8353a4c-412d-47b4-94f5-c992a1e1d678 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:54.234932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8353a4c-412d-47b4-94f5-c992a1e1d678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:54.236906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 822/1638] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:54.258739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d169-1941-4c59-8ee3-0c3ed7690e05 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:54.275873 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c8353a4c-412d-47b4-94f5-c992a1e1d678 None None] MFA Rules not processed for user `e3609a9d4fe144b68a62ad4696301244`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:54.277108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c8353a4c-412d-47b4-94f5-c992a1e1d678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:54.279750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16d169-1941-4c59-8ee3-0c3ed7690e05 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:54.288242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a2aef-0e9c-49fd-8f5b-f2cc3b6c1525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:54.288908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2aef-0e9c-49fd-8f5b-f2cc3b6c1525 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:54.289812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2aef-0e9c-49fd-8f5b-f2cc3b6c1525 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:54.290094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2aef-0e9c-49fd-8f5b-f2cc3b6c1525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:54.309631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 817/1639] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:54.406145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a2aef-0e9c-49fd-8f5b-f2cc3b6c1525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:54.408330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8353a4c-412d-47b4-94f5-c992a1e1d678 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:54.420014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a2aef-0e9c-49fd-8f5b-f2cc3b6c1525 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:54.427930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8353a4c-412d-47b4-94f5-c992a1e1d678 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:54.439705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 823/1640] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:18:54.442382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5effaf0-ccb6-425d-b3b5-f4b847d5ac0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:54.442382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effaf0-ccb6-425d-b3b5-f4b847d5ac0e service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:54.442812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effaf0-ccb6-425d-b3b5-f4b847d5ac0e service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:54.443995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effaf0-ccb6-425d-b3b5-f4b847d5ac0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:54.454599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5effaf0-ccb6-425d-b3b5-f4b847d5ac0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:54.456414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5effaf0-ccb6-425d-b3b5-f4b847d5ac0e service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:54.472758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 818/1641] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:54.663702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b11c1-d321-4255-8edc-28d7e5fb28c9 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:54.663999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b11c1-d321-4255-8edc-28d7e5fb28c9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:54.664363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b11c1-d321-4255-8edc-28d7e5fb28c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:54.710521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-492b11c1-d321-4255-8edc-28d7e5fb28c9 None None] MFA Rules not processed for user `c4e830b3807c421e9039bb78a42c393d`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:54.711781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-492b11c1-d321-4255-8edc-28d7e5fb28c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:54.823910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 824/1642] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:54.837237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3527-7df6-4574-9cda-d0be9f001f87 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:54.837742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3527-7df6-4574-9cda-d0be9f001f87 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:54.838157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3527-7df6-4574-9cda-d0be9f001f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:54.867395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-5c1a3527-7df6-4574-9cda-d0be9f001f87 None None] MFA Rules not processed for user `c4e830b3807c421e9039bb78a42c393d`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:54.869464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5c1a3527-7df6-4574-9cda-d0be9f001f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:54.900171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 819/1643] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:54.900408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b11c1-d321-4255-8edc-28d7e5fb28c9 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:54.913546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b11c1-d321-4255-8edc-28d7e5fb28c9 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:54.921648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af07e64-2c99-4c20-8696-6724bbb4a924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:54.922045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07e64-2c99-4c20-8696-6724bbb4a924 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:54.922363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07e64-2c99-4c20-8696-6724bbb4a924 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:54.922669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07e64-2c99-4c20-8696-6724bbb4a924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:54.931665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af07e64-2c99-4c20-8696-6724bbb4a924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:54.933305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af07e64-2c99-4c20-8696-6724bbb4a924 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:54.944575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 825/1644] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:18:55.334145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0708c-1f3b-46ce-a888-b8bd437352a4 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:55.335023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0708c-1f3b-46ce-a888-b8bd437352a4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:55.335474 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0708c-1f3b-46ce-a888-b8bd437352a4 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:55.338264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 820/1645] 10.222.0.31 () {54 vars in 912 bytes} [Sat Feb 12 04:18:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:18:55.343915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d565-063d-45f1-91d6-af0d2187a7ce None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:55.344745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d565-063d-45f1-91d6-af0d2187a7ce None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:55.345171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d565-063d-45f1-91d6-af0d2187a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:55.389497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c1a6d565-063d-45f1-91d6-af0d2187a7ce None None] MFA Rules not processed for user `5157463790394bcbae9c0d7e5812f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:55.390970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c1a6d565-063d-45f1-91d6-af0d2187a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:55.459268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 826/1646] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:55.512210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0708c-1f3b-46ce-a888-b8bd437352a4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:55.525237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0708c-1f3b-46ce-a888-b8bd437352a4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:55.530848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8135a1-b89f-4074-9e1d-d7663ba3453d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:55.531575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8135a1-b89f-4074-9e1d-d7663ba3453d service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:55.531925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8135a1-b89f-4074-9e1d-d7663ba3453d service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:55.532322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8135a1-b89f-4074-9e1d-d7663ba3453d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:55.544143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8135a1-b89f-4074-9e1d-d7663ba3453d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:55.545836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8135a1-b89f-4074-9e1d-d7663ba3453d service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:55.554776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 821/1647] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:55.907716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a125-ef21-4954-8be5-190b947c0d22 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:55.907716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a125-ef21-4954-8be5-190b947c0d22 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:55.907716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6a125-ef21-4954-8be5-190b947c0d22 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:55.907716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 827/1648] 10.222.0.31 () {54 vars in 912 bytes} [Sat Feb 12 04:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:18:55.910230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e13f4-d2c3-4c8e-8893-80600d803f6e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:55.910230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e13f4-d2c3-4c8e-8893-80600d803f6e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:55.910230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e13f4-d2c3-4c8e-8893-80600d803f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:55.929006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8a5e13f4-d2c3-4c8e-8893-80600d803f6e None None] MFA Rules not processed for user `5157463790394bcbae9c0d7e5812f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:55.929006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8a5e13f4-d2c3-4c8e-8893-80600d803f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:55.936574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 822/1649] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:56.087620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a125-ef21-4954-8be5-190b947c0d22 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:56.138709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6a125-ef21-4954-8be5-190b947c0d22 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:56.145954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6539e3-2f5d-4965-8e83-a5dd34b550b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:56.148299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6539e3-2f5d-4965-8e83-a5dd34b550b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:56.148299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6539e3-2f5d-4965-8e83-a5dd34b550b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:56.148299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6539e3-2f5d-4965-8e83-a5dd34b550b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:56.163648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6539e3-2f5d-4965-8e83-a5dd34b550b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:56.166629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6539e3-2f5d-4965-8e83-a5dd34b550b0 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:56.183175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 828/1650] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:56.944613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e13f4-d2c3-4c8e-8893-80600d803f6e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:57.099675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e13f4-d2c3-4c8e-8893-80600d803f6e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:57.111588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e782343-d662-43e0-b32e-38e410b99aff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:57.112424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e782343-d662-43e0-b32e-38e410b99aff service placement] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:57.113182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e782343-d662-43e0-b32e-38e410b99aff service placement] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:57.114038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e782343-d662-43e0-b32e-38e410b99aff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:57.117217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1e782343-d662-43e0-b32e-38e410b99aff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:57.135764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e782343-d662-43e0-b32e-38e410b99aff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:57.137921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e782343-d662-43e0-b32e-38e410b99aff service placement] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:57.181085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 823/1651] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:18:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:59.805764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b156-ab23-498f-b455-f837bfd3af62 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:59.806752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b156-ab23-498f-b455-f837bfd3af62 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:59.807276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b156-ab23-498f-b455-f837bfd3af62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:59.875170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2097b156-ab23-498f-b455-f837bfd3af62 None None] MFA Rules not processed for user `12659c94a0e54cb885e5398cd4ce4469`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:59.876650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2097b156-ab23-498f-b455-f837bfd3af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:00.303571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 829/1652] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:00.308757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951133-8e81-4305-b6d3-4c4d2e6616bd None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:00.308757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951133-8e81-4305-b6d3-4c4d2e6616bd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:00.308757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90951133-8e81-4305-b6d3-4c4d2e6616bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:00.308757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-90951133-8e81-4305-b6d3-4c4d2e6616bd None None] MFA Rules not processed for user `12659c94a0e54cb885e5398cd4ce4469`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:00.308757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-90951133-8e81-4305-b6d3-4c4d2e6616bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:00.308757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 824/1653] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:00.309987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097b156-ab23-498f-b455-f837bfd3af62 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:00.309987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097b156-ab23-498f-b455-f837bfd3af62 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:00.309987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2119-aff4-4229-96f3-edd20ec61dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:00.309987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2119-aff4-4229-96f3-edd20ec61dc5 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:00.310785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2119-aff4-4229-96f3-edd20ec61dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:00.310785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2119-aff4-4229-96f3-edd20ec61dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:00.310785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c2119-aff4-4229-96f3-edd20ec61dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:00.310785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c2119-aff4-4229-96f3-edd20ec61dc5 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:00.310785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 830/1654] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:01.747196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fc3e-d643-4753-aaa3-557cd0485485 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:01.748271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fc3e-d643-4753-aaa3-557cd0485485 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:01.749236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31fc3e-d643-4753-aaa3-557cd0485485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:01.791120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2d31fc3e-d643-4753-aaa3-557cd0485485 None None] MFA Rules not processed for user `12659c94a0e54cb885e5398cd4ce4469`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:01.793428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2d31fc3e-d643-4753-aaa3-557cd0485485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:01.828100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 825/1655] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:03.227949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04632-9387-4d65-b909-5652d799a2c7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:03.228460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04632-9387-4d65-b909-5652d799a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:03.228556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec04632-9387-4d65-b909-5652d799a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:03.276302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-dec04632-9387-4d65-b909-5652d799a2c7 None None] MFA Rules not processed for user `86560704b2374f75bc32b19475b63462`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:03.341447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dec04632-9387-4d65-b909-5652d799a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:03.400618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 831/1656] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:03.497226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fc3e-d643-4753-aaa3-557cd0485485 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:03.515614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31fc3e-d643-4753-aaa3-557cd0485485 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:03.524656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:03.525569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:03.525917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:03.526267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:03.539635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:03.541439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:03.555927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 826/1657] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:05.478178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a9c71-c796-45c1-953f-320fdb878ca3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:05.481078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a9c71-c796-45c1-953f-320fdb878ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:05.481565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a9c71-c796-45c1-953f-320fdb878ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:05.524980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0e4a9c71-c796-45c1-953f-320fdb878ca3 None None] MFA Rules not processed for user `19c700111c474ff596979fb4150fa15c`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:05.526215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0e4a9c71-c796-45c1-953f-320fdb878ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:05.614254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 832/1658] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:05.620410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:05.647238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b341ef-6570-4278-9263-6dfabcab9bee service nova] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:05.666013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec39db-11cb-44b4-a4c3-d3954c7e618f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:05.666013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec39db-11cb-44b4-a4c3-d3954c7e618f service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:05.666013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec39db-11cb-44b4-a4c3-d3954c7e618f service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:05.666013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec39db-11cb-44b4-a4c3-d3954c7e618f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:05.682913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec39db-11cb-44b4-a4c3-d3954c7e618f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:05.691086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec39db-11cb-44b4-a4c3-d3954c7e618f service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:05.734626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 827/1659] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:06.702087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a9c71-c796-45c1-953f-320fdb878ca3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:06.751051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67bbcb-05cc-4b61-ba1a-a9c099661e67 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:06.751578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67bbcb-05cc-4b61-ba1a-a9c099661e67 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:06.751578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67bbcb-05cc-4b61-ba1a-a9c099661e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:06.796963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-cd67bbcb-05cc-4b61-ba1a-a9c099661e67 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:06.800504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cd67bbcb-05cc-4b61-ba1a-a9c099661e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:06.885815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a9c71-c796-45c1-953f-320fdb878ca3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:06.897231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:06.899181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:06.899181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:06.899610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] PATH_INFO: `/v3/users/05caf5a818e049f094f42271993ae3e3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:06.902843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] RBAC: Authorizing `identity:delete_user(user_id=05caf5a818e049f094f42271993ae3e3)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:06.903992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: WARNING py.warnings [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:06.903992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: warnings.warn(msg) Feb 12 04:19:06.903992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: Feb 12 04:19:06.909078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:06.932971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 828/1660] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:19:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:07.098716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67bbcb-05cc-4b61-ba1a-a9c099661e67 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:07.163330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67bbcb-05cc-4b61-ba1a-a9c099661e67 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:07.216198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:07.217185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:07.223656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:07.224610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] PATH_INFO: `/v3/users/8ad163f747794b6789d79fff4b9c797d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:07.249389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad163f747794b6789d79fff4b9c797d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:07.249389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:07.353021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05caf5a818e049f094f42271993ae3e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.353021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05caf5a818e049f094f42271993ae3e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.393838 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05caf5a818e049f094f42271993ae3e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.571035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05caf5a818e049f094f42271993ae3e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.571666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05caf5a818e049f094f42271993ae3e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.641196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 833/1661] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:06 2022] DELETE /identity/v3/users/05caf5a818e049f094f42271993ae3e3 => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:07.645197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:07.649040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:07.735411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad163f747794b6789d79fff4b9c797d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.738483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad163f747794b6789d79fff4b9c797d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.828050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a227-7345-42d9-8fef-bd74fa7b3add admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:07.841248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3affd-3902-484a-830c-e5b1497eb12d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:07.842039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3affd-3902-484a-830c-e5b1497eb12d service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:07.842396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3affd-3902-484a-830c-e5b1497eb12d service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:07.842747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3affd-3902-484a-830c-e5b1497eb12d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:07.850037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-07d3affd-3902-484a-830c-e5b1497eb12d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:07.896598 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad163f747794b6789d79fff4b9c797d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.968299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad163f747794b6789d79fff4b9c797d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.970808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5bf614bb-078d-432f-b885-9b3618941e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad163f747794b6789d79fff4b9c797d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:07.987284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3affd-3902-484a-830c-e5b1497eb12d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:07.989783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3affd-3902-484a-830c-e5b1497eb12d service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:08.016924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 829/1662] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:07 2022] DELETE /identity/v3/users/8ad163f747794b6789d79fff4b9c797d => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:08.022011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 834/1663] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:19:08.022737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394613d5-c634-478a-b39b-95690578b181 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:08.024265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394613d5-c634-478a-b39b-95690578b181 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:08.025954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394613d5-c634-478a-b39b-95690578b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:08.026398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:08.026949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:08.031062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:08.091120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-394613d5-c634-478a-b39b-95690578b181 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:08.093044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:08.094773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-394613d5-c634-478a-b39b-95690578b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:08.100027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:08.272266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 830/1664] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:08.313796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 835/1665] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:08.421920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394613d5-c634-478a-b39b-95690578b181 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:08.423391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:08.423510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-394613d5-c634-478a-b39b-95690578b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:08.429028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:08.598995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5a109-0440-4630-80ef-e1cbbdf85ee2 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:08.606913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084f385-3b8f-4d25-b645-ac1785e6851b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:08.607817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f385-3b8f-4d25-b645-ac1785e6851b service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:08.608240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f385-3b8f-4d25-b645-ac1785e6851b service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:08.608783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084f385-3b8f-4d25-b645-ac1785e6851b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:08.632033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f385-3b8f-4d25-b645-ac1785e6851b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:08.634337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084f385-3b8f-4d25-b645-ac1785e6851b service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:08.656472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394613d5-c634-478a-b39b-95690578b181 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:08.661034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 836/1666] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:08.675626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:08.676379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:08.676663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:08.676953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:08.714904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:08.719116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:08.780644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 831/1667] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:10.676749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc566-ff40-4e05-90b9-73338825e7d0 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:10.682222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc566-ff40-4e05-90b9-73338825e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:10.682222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc566-ff40-4e05-90b9-73338825e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:10.713718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:10.720066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d79bc566-ff40-4e05-90b9-73338825e7d0 None None] MFA Rules not processed for user `5157463790394bcbae9c0d7e5812f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:10.720465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:10.720561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d79bc566-ff40-4e05-90b9-73338825e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:10.736854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 837/1668] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Feb 12 04:19:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:10.753408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d971fb-3611-4491-b16a-4df20f13d454 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:10.768909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:10.772428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:10.777825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:10.777825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] PATH_INFO: `/v3/users/e45b16b4f82844a0baea20331b44fabd` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:10.780235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45b16b4f82844a0baea20331b44fabd)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:10.782636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:10.827236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bc566-ff40-4e05-90b9-73338825e7d0 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:10.838199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bc566-ff40-4e05-90b9-73338825e7d0 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:10.859262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1602a57-decd-405e-8c85-cb5e0bbb1026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:10.864070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602a57-decd-405e-8c85-cb5e0bbb1026 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:10.866556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602a57-decd-405e-8c85-cb5e0bbb1026 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:10.869734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602a57-decd-405e-8c85-cb5e0bbb1026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:10.892637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602a57-decd-405e-8c85-cb5e0bbb1026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:10.896240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602a57-decd-405e-8c85-cb5e0bbb1026 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:10.918396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 838/1669] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:11.050788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45b16b4f82844a0baea20331b44fabd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:11.055658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45b16b4f82844a0baea20331b44fabd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:11.193491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45b16b4f82844a0baea20331b44fabd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:11.215944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45b16b4f82844a0baea20331b44fabd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:11.218405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45b16b4f82844a0baea20331b44fabd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:11.249734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 832/1670] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:10 2022] DELETE /identity/v3/users/e45b16b4f82844a0baea20331b44fabd => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:11.254112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:11.254410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:11.254686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:11.312708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:11.313979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:11.527673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 839/1671] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:11.539205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:11.542210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:11.688288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3529a42-2625-48fb-8aa7-8c09ff0d63bd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:11.699245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:11.700264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:11.700531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:11.700821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:11.730125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:11.730125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:11.741308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 833/1672] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:12.219890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:12.221722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:12.244356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a67d3-1f9b-47c4-9b80-7c032bef69ca None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:12.258421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:12.259387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:12.259673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:12.259953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] PATH_INFO: `/v3/projects/0ca780f7a20a47f881ad0a8588cfae15` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:12.264817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca780f7a20a47f881ad0a8588cfae15)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:12.267467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:12.731689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca780f7a20a47f881ad0a8588cfae15', 'request_id': 'req-03e62539-c8dd-4da9-a36d-8cdee575bc8a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:12.862039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca780f7a20a47f881ad0a8588cfae15', 'request_id': 'req-03e62539-c8dd-4da9-a36d-8cdee575bc8a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:12.871974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca780f7a20a47f881ad0a8588cfae15', 'request_id': 'req-03e62539-c8dd-4da9-a36d-8cdee575bc8a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:12.880164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:12.881647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:12.904951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97aed5-2374-4727-bcc7-664f31f08904 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:12.915502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] The token cache is being invalidate because project 0ca780f7a20a47f881ad0a8588cfae15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:12.915806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:12.916524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-03e62539-c8dd-4da9-a36d-8cdee575bc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:12.930949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 840/1673] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:12 2022] DELETE /identity/v3/projects/0ca780f7a20a47f881ad0a8588cfae15 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:12.932478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6fbf-7a97-4efc-9bc4-aa673e74e33a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:12.932817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6fbf-7a97-4efc-9bc4-aa673e74e33a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:12.933113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c6fbf-7a97-4efc-9bc4-aa673e74e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:12.978655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-187c6fbf-7a97-4efc-9bc4-aa673e74e33a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:12.980053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-187c6fbf-7a97-4efc-9bc4-aa673e74e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:13.110578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:13.111496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.111784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.112066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] PATH_INFO: `/v3/projects/b796ac226697409fbca7f7253ac67292` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.113439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b796ac226697409fbca7f7253ac67292)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:13.114547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: WARNING py.warnings [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:19:13.114547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: warnings.warn(msg) Feb 12 04:19:13.114547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: Feb 12 04:19:13.115736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:13.157695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 841/1674] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:13.166287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b1558-ca2b-4a3d-9179-728f5053620c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.166573 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b1558-ca2b-4a3d-9179-728f5053620c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.166859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b1558-ca2b-4a3d-9179-728f5053620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.193899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-766b1558-ca2b-4a3d-9179-728f5053620c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:13.196600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-766b1558-ca2b-4a3d-9179-728f5053620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:13.211546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 842/1675] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:13.217757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b1558-ca2b-4a3d-9179-728f5053620c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:13.231377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b1558-ca2b-4a3d-9179-728f5053620c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:13.265130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b796ac226697409fbca7f7253ac67292', 'request_id': 'req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:13.350654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:13.352247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.353073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.353608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.354635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:13.355267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:13.364781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b796ac226697409fbca7f7253ac67292', 'request_id': 'req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:13.369707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:13.385866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 843/1676] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:13.390576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:13.412254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b796ac226697409fbca7f7253ac67292', 'request_id': 'req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:13.426517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991789-337f-4ffd-ac3d-004ea042deee admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:13.434254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] The token cache is being invalidate because project b796ac226697409fbca7f7253ac67292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:13.434764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:13.437590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ba38b56f-0cbe-46f7-8cc0-de6143733d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:13.443106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 834/1677] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:12 2022] DELETE /identity/v3/projects/b796ac226697409fbca7f7253ac67292 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:13.444860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:13.446236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.446766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.447142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.447928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:13.450425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208396-84bc-45ac-b993-d07b3d8c53cc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.451107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208396-84bc-45ac-b993-d07b3d8c53cc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.451573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8208396-84bc-45ac-b993-d07b3d8c53cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.466280 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:13.479190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f8208396-84bc-45ac-b993-d07b3d8c53cc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:13.484750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f8208396-84bc-45ac-b993-d07b3d8c53cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:13.503986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 835/1678] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:13.505738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7c01-eff6-492a-b317-78b5082515cf None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.506192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7c01-eff6-492a-b317-78b5082515cf None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.506645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7c01-eff6-492a-b317-78b5082515cf None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.508721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 836/1679] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:13.528349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70e50b-bdf7-441d-ad7c-9fe779a325ab None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.528729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70e50b-bdf7-441d-ad7c-9fe779a325ab None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.529070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70e50b-bdf7-441d-ad7c-9fe779a325ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.602897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-df70e50b-bdf7-441d-ad7c-9fe779a325ab None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:13.611584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 844/1680] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:13 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:13.611878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-df70e50b-bdf7-441d-ad7c-9fe779a325ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:13.612694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:13.626218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:13.750752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 837/1681] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:13.752355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b323e7-f193-44e9-a1ec-2dce7b4217d4 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.752650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b323e7-f193-44e9-a1ec-2dce7b4217d4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.768836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b323e7-f193-44e9-a1ec-2dce7b4217d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.778852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0586-9b48-45e8-be44-7c6e61ffda77 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:13.785151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:13.786531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.786981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.787269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.788185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:13.794854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:13.826673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-02b323e7-f193-44e9-a1ec-2dce7b4217d4 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:13.826673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-02b323e7-f193-44e9-a1ec-2dce7b4217d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:13.914580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 845/1682] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:13 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:13.917699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:13.943751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d5d02-56f5-4e0b-be67-24a2719271eb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:13.957771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:13.959147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:13.959699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:13.960229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:13.961940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:13.962448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:13.964593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:13.992387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 846/1683] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:13.993625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.008427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a3ffc-50c8-43c4-8f4c-2c69b3fa7e7f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:14.016357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:14.020805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.021494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.022003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.023970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:14.026319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:14.030978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 838/1684] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:14.034020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b323e7-f193-44e9-a1ec-2dce7b4217d4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.046272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 847/1685] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:14.047527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.067879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17099-fc46-4c34-bee7-7fdb2bfa81a9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:14.074477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b323e7-f193-44e9-a1ec-2dce7b4217d4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:14.075224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:14.076112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.076575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.077126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.080492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:14.082984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:14.101962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 848/1686] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:19:14.104641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.107096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2e0b5-b7e8-4240-a2f3-c389870f4cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:14.108205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2e0b5-b7e8-4240-a2f3-c389870f4cae admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.109921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2e0b5-b7e8-4240-a2f3-c389870f4cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.110222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2e0b5-b7e8-4240-a2f3-c389870f4cae admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.111601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2e0b5-b7e8-4240-a2f3-c389870f4cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:14.113702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2e0b5-b7e8-4240-a2f3-c389870f4cae admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:14.120979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199bd89-aac2-4334-86b0-39d5070e95bd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:14.129561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:14.130559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.130819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.131906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] PATH_INFO: `/v3/projects/7ff5c849c806432a9e7b8fbaebad909c/users/35299e0dd06d4e0abc287f787a111309/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.157266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff5c849c806432a9e7b8fbaebad909c, user_id=35299e0dd06d4e0abc287f787a111309, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:14.161154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:14.264418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 849/1687] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:14 2022] PUT /identity/v3/projects/7ff5c849c806432a9e7b8fbaebad909c/users/35299e0dd06d4e0abc287f787a111309/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:14.267337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 839/1688] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:14 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:14.271663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.275850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.286414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.286798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.351920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] MFA Rules not processed for user `35299e0dd06d4e0abc287f787a111309`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:14.354303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:14.403420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dca2e7-9524-47dd-a1e3-62f6db089ea6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:14.479881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 840/1689] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:14.481532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.483905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:14.509863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:14.510510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.510792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.511140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.511912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:14.514032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:14.583732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a828ea-fbd5-4a15-88a2-588e3057324c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:14.590034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:14.591070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.591604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.591989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] PATH_INFO: `/v3/projects/2c6cbd6f5db9481eafeacab911285b1f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.593964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6cbd6f5db9481eafeacab911285b1f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:14.596643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:14.673116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 850/1690] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:14 2022] POST /identity/v3/users => generated 283 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:14.675716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.707640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fb82c-1017-4c4d-b01c-c9074eae4d70 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:14.722791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c361-3666-4c6e-92f5-35513940ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:14.723939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c361-3666-4c6e-92f5-35513940ac84 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.724226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c361-3666-4c6e-92f5-35513940ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.725689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c361-3666-4c6e-92f5-35513940ac84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.728443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8c361-3666-4c6e-92f5-35513940ac84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:14.730626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8c361-3666-4c6e-92f5-35513940ac84 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:14.791011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6cbd6f5db9481eafeacab911285b1f', 'request_id': 'req-e0350b08-2e21-4b19-91e6-981570a078f3'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:14.880259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 851/1691] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:14 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:14.882030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:14.882578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:14.882704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:14.895967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6cbd6f5db9481eafeacab911285b1f', 'request_id': 'req-e0350b08-2e21-4b19-91e6-981570a078f3'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:14.913211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6cbd6f5db9481eafeacab911285b1f', 'request_id': 'req-e0350b08-2e21-4b19-91e6-981570a078f3'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:14.949906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] The token cache is being invalidate because project 2c6cbd6f5db9481eafeacab911285b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:14.950266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:14.951809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] MFA Rules not processed for user `86560704b2374f75bc32b19475b63462`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:14.953174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:14.953708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:14.957485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 841/1692] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:14 2022] DELETE /identity/v3/projects/2c6cbd6f5db9481eafeacab911285b1f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:14.959038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:14.962064 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:15.071271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350b08-2e21-4b19-91e6-981570a078f3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:15.087818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 852/1693] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:15.089221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:15.095122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:15.155723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:15.156605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:15.157003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:15.157554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:15.158444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:15.163229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:15.182741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 842/1694] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:15.187068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:15.189161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:15.244299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77518e-a68d-43b8-a0b9-2a9fb879baa4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:15.261710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:15.262514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:15.263074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:15.264373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:15.265120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:15.267112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:15.307872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa1918-8421-4be3-92e2-12168c593bdb None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:15.325156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:15.325907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:15.326224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:15.326433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:15.333145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:15.370114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:15.372037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:15.398885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 853/1695] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:15.399341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:15.413354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:15.550174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84568e28-ccc7-49c8-831c-5488aeffbf57 service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:15.550174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:15.550174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:15.550174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:15.551800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] PATH_INFO: `/v3/users/1523aef24eef4d78b642f3be4417488b` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:15.551800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1523aef24eef4d78b642f3be4417488b)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:15.551800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:16.277137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 843/1696] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:15 2022] POST /identity/v3/users => generated 290 bytes in 974 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:16.277137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:16.277137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e0cb-517c-4232-8d44-5886b59c8b4e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:16.277137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:16.279453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:16.279453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:16.279453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:16.279453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:16.279453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:16.279453 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 844/1697] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:16.280119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:16.290605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c98d32-c91c-48ab-978b-3742368a7248 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:16.299916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:16.299916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:16.299916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:16.299916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:16.300314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:16.300314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:16.312536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 845/1698] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:16.313736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:16.330508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d1b1-b84b-4c2a-ac30-fec3997c1383 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:16.340214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:16.340214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:16.340214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:16.340214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] PATH_INFO: `/v3/projects/681de655d34e45fab71f9552227617bf/users/6f6a2679757846ccbc4c559da3564994/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:16.358992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=681de655d34e45fab71f9552227617bf, user_id=6f6a2679757846ccbc4c559da3564994, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:16.362315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:16.493054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1523aef24eef4d78b642f3be4417488b'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:16.493933 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1523aef24eef4d78b642f3be4417488b'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:16.517322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 846/1699] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:16 2022] PUT /identity/v3/projects/681de655d34e45fab71f9552227617bf/users/6f6a2679757846ccbc4c559da3564994/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:16.517322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:16.536855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1523aef24eef4d78b642f3be4417488b'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:16.644086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1523aef24eef4d78b642f3be4417488b'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:16.645227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-32ec0bfd-cb8a-4068-9fe3-9a84139e4342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1523aef24eef4d78b642f3be4417488b'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:16.652472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a52722-525a-4bb5-b3ab-4f670c8c7d63 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:16.659717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df52598-6b40-4cb0-a678-e92a36639d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:16.659717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52598-6b40-4cb0-a678-e92a36639d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:16.659717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52598-6b40-4cb0-a678-e92a36639d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:16.660179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df52598-6b40-4cb0-a678-e92a36639d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:16.661739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df52598-6b40-4cb0-a678-e92a36639d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:16.689564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df52598-6b40-4cb0-a678-e92a36639d74 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:16.697996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 854/1700] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:15 2022] DELETE /identity/v3/users/1523aef24eef4d78b642f3be4417488b => generated 0 bytes in 1300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:16.702008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb74c6-4fa9-4e68-8bd8-0644bed2a504 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:16.702330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb74c6-4fa9-4e68-8bd8-0644bed2a504 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:16.702622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb74c6-4fa9-4e68-8bd8-0644bed2a504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:16.739742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 847/1701] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:16.741717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7190c61-6d12-4e2f-8c25-ff202ef54ae6 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:16.742296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7190c61-6d12-4e2f-8c25-ff202ef54ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:16.744661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7190c61-6d12-4e2f-8c25-ff202ef54ae6 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:16.747013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 848/1702] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:19:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:16.749820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7190c61-6d12-4e2f-8c25-ff202ef54ae6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:16.755014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a7190c61-6d12-4e2f-8c25-ff202ef54ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:16.773091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d0fb74c6-4fa9-4e68-8bd8-0644bed2a504 None None] MFA Rules not processed for user `6f6a2679757846ccbc4c559da3564994`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:16.780005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d0fb74c6-4fa9-4e68-8bd8-0644bed2a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:16.938545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7190c61-6d12-4e2f-8c25-ff202ef54ae6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:16.960649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:16.960649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:16.960649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:16.960649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] PATH_INFO: `/v3/projects/5295d50e952a41419664028834b6afd2/users/16647292178b4b109ad01ee399870d5e/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:16.985909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5295d50e952a41419664028834b6afd2, user_id=16647292178b4b109ad01ee399870d5e, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:16.988729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:17.027906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 855/1703] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:17.027906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e0658-0dd5-4c10-b885-4b6b7ca8c9b3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:17.028180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e0658-0dd5-4c10-b885-4b6b7ca8c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:17.029476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e0658-0dd5-4c10-b885-4b6b7ca8c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:17.057337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-886e0658-0dd5-4c10-b885-4b6b7ca8c9b3 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:17.058536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-886e0658-0dd5-4c10-b885-4b6b7ca8c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:17.133424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 849/1704] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:16 2022] PUT /identity/v3/projects/5295d50e952a41419664028834b6afd2/users/16647292178b4b109ad01ee399870d5e/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:17.149265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:17.152661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:17.202174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 856/1705] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:19:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:17.203822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f40b94-10d4-4501-9565-71c58c4bb215 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:17.204155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f40b94-10d4-4501-9565-71c58c4bb215 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:17.204468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f40b94-10d4-4501-9565-71c58c4bb215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:17.273687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e2f40b94-10d4-4501-9565-71c58c4bb215 None None] MFA Rules not processed for user `16647292178b4b109ad01ee399870d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:17.275021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e2f40b94-10d4-4501-9565-71c58c4bb215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:17.362911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b641f-9307-4f67-9810-fe5ec6a95855 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:17.375226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:17.375914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:17.376458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:17.376745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:17.449326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 857/1706] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:17.454887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f40b94-10d4-4501-9565-71c58c4bb215 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:17.564727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:17.567221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:17.594163 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 850/1707] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:17.661737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f40b94-10d4-4501-9565-71c58c4bb215 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:17.670606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:17.671377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:17.672020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:17.672489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:17.680042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:17.687899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:17.806564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:17.808241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:17.820008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 858/1708] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:17 2022] POST /identity/v3/projects => generated 379 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:17.824441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:17.967967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189c93-da84-4b33-98a5-5d9123d25cf5 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.016972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2dc4a-f4b3-4b95-9d34-c8df59250cbc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.022882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.025020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.025589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.026092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.027066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.029821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.127981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 859/1709] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:17 2022] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:18.137314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:18.159279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.159613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104776-5e11-4854-a506-21659a98a2d1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.161061 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.161622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.162393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.170869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.171915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.174535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.175115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.176043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.184858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.185303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.198066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.213355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 860/1710] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:18.217070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 851/1711] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:18.217821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:18.230770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae05c5-7f39-4a80-b81c-4e00286cb25c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.245948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.246944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.247408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.247716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] PATH_INFO: `/v3/projects/4279bb2c18b94bd8a6d7b3b70fd7cea4/users/d36d551e9149495b8db35a6fb8f3d91d/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.281872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4279bb2c18b94bd8a6d7b3b70fd7cea4, user_id=d36d551e9149495b8db35a6fb8f3d91d, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.288278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.411906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 861/1712] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:18 2022] PUT /identity/v3/projects/4279bb2c18b94bd8a6d7b3b70fd7cea4/users/d36d551e9149495b8db35a6fb8f3d91d/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:18.418415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:18.437540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71bed-d6d3-4e6f-8484-5925fb33cab4 service nova] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.549328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dde04d-83ad-4ea0-96f5-ec9c090aa4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.549595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde04d-83ad-4ea0-96f5-ec9c090aa4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.550009 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde04d-83ad-4ea0-96f5-ec9c090aa4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.551165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde04d-83ad-4ea0-96f5-ec9c090aa4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.551165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dde04d-83ad-4ea0-96f5-ec9c090aa4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.553168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dde04d-83ad-4ea0-96f5-ec9c090aa4a8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.571875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 852/1713] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:18.574024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:18.591954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af8cf1-1e08-4d09-b29a-5a2c1f24fdd7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.604342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff6efe-6b9d-4308-83ca-fe05153b0282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.605453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6efe-6b9d-4308-83ca-fe05153b0282 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.605766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6efe-6b9d-4308-83ca-fe05153b0282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.608380 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6efe-6b9d-4308-83ca-fe05153b0282 admin admin] PATH_INFO: `/v3/projects/4279bb2c18b94bd8a6d7b3b70fd7cea4/users/d36d551e9149495b8db35a6fb8f3d91d/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.613734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff6efe-6b9d-4308-83ca-fe05153b0282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4279bb2c18b94bd8a6d7b3b70fd7cea4, user_id=d36d551e9149495b8db35a6fb8f3d91d, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.616511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff6efe-6b9d-4308-83ca-fe05153b0282 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.645255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 862/1714] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:18 2022] PUT /identity/v3/projects/4279bb2c18b94bd8a6d7b3b70fd7cea4/users/d36d551e9149495b8db35a6fb8f3d91d/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:18.659344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.659514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.659929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.777829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] MFA Rules not processed for user `d36d551e9149495b8db35a6fb8f3d91d`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:18.779234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:18.983260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab89371-0d33-4ed1-92ea-022f805219dd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.983818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab89371-0d33-4ed1-92ea-022f805219dd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.983818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab89371-0d33-4ed1-92ea-022f805219dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.009382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-dab89371-0d33-4ed1-92ea-022f805219dd None None] MFA Rules not processed for user `19c700111c474ff596979fb4150fa15c`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:19.009839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dab89371-0d33-4ed1-92ea-022f805219dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:19.048405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 853/1715] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:19.051858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:19.059285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:19.125233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 863/1716] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:19.126290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab89371-0d33-4ed1-92ea-022f805219dd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:19.219416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0db24-a988-4d22-a003-aaaedd0c8753 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:19.227291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:19.228384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:19.228662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:19.228951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] PATH_INFO: `/v3/projects/2e5ddf84f48a438da2ef2e961cb1aed1` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.230332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5ddf84f48a438da2ef2e961cb1aed1)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:19.232488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:19.239466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab89371-0d33-4ed1-92ea-022f805219dd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:19.249191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:19.249480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:19.250769 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:19.251333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.270417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:19.273951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:19.288979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 864/1717] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:19.377314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5ddf84f48a438da2ef2e961cb1aed1', 'request_id': 'req-30792cd3-ed33-4d0a-b214-7df33bfeb608'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:19.449949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5ddf84f48a438da2ef2e961cb1aed1', 'request_id': 'req-30792cd3-ed33-4d0a-b214-7df33bfeb608'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:19.459178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5ddf84f48a438da2ef2e961cb1aed1', 'request_id': 'req-30792cd3-ed33-4d0a-b214-7df33bfeb608'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:19.459756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:19.463205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:19.482500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc830fc-b4a2-47c7-a1f6-3fbddf406fbf service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:19.487612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] The token cache is being invalidate because project 2e5ddf84f48a438da2ef2e961cb1aed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:19.487987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:19.488828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-30792cd3-ed33-4d0a-b214-7df33bfeb608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:19.490770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 854/1718] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:19 2022] DELETE /identity/v3/projects/2e5ddf84f48a438da2ef2e961cb1aed1 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:19.496079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5403a-6f93-40aa-82d4-afaa0d0e45af None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:19.498415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5403a-6f93-40aa-82d4-afaa0d0e45af None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:19.498826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5403a-6f93-40aa-82d4-afaa0d0e45af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.557860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a0d5403a-6f93-40aa-82d4-afaa0d0e45af None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:19.561695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a0d5403a-6f93-40aa-82d4-afaa0d0e45af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:19.609446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec23d06-99b7-402b-ac6f-6121ee4a427f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:19.610175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23d06-99b7-402b-ac6f-6121ee4a427f service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:19.610459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23d06-99b7-402b-ac6f-6121ee4a427f service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:19.610735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23d06-99b7-402b-ac6f-6121ee4a427f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.616747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dec23d06-99b7-402b-ac6f-6121ee4a427f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:19.723859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec23d06-99b7-402b-ac6f-6121ee4a427f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:19.725645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec23d06-99b7-402b-ac6f-6121ee4a427f service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:19.748962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 865/1719] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:19.768238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 855/1720] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:19.769625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a724d4-899f-455f-8627-097175bd7075 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:19.769940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a724d4-899f-455f-8627-097175bd7075 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:19.770225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a724d4-899f-455f-8627-097175bd7075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.810100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-53a724d4-899f-455f-8627-097175bd7075 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:19.810100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-53a724d4-899f-455f-8627-097175bd7075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:19.831524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 866/1721] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:19.835778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5403a-6f93-40aa-82d4-afaa0d0e45af None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:19.854417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5403a-6f93-40aa-82d4-afaa0d0e45af None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:19.868479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:19.869527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:19.869933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:19.870342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.871195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:19.871705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:19.873659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:19.921681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 856/1722] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:19.926219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a724d4-899f-455f-8627-097175bd7075 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:19.944721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a724d4-899f-455f-8627-097175bd7075 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:19.954970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:19.955798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:19.956233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:19.956688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:19.957504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:19.959695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.087481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.087972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 867/1723] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:19 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:20.100275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b226c-1ef2-4d20-b776-d2583d7ea980 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.265366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.265366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.265366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.265366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.265906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:20.267664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.430843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 857/1724] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:20 2022] POST /identity/v3/users => generated 285 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:20.432853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.445605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5abcd-bc8b-43d3-9890-084151e6926b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.451755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.452983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.453332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.453627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.454389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:20.462071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.475882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 868/1725] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:20.481310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.505570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84ed7-7668-48e4-b22c-44ce2bbb7e63 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.521110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9f048-296b-40cb-b056-861385c5b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.521110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f048-296b-40cb-b056-861385c5b637 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.521110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f048-296b-40cb-b056-861385c5b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.525800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9f048-296b-40cb-b056-861385c5b637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.528470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9f048-296b-40cb-b056-861385c5b637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:20.540435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9f048-296b-40cb-b056-861385c5b637 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.577195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 858/1726] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:20.577920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.603953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5594c4d-05c3-4f3d-a7b8-cd660b180c94 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.621652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.623019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.623529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.624059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] PATH_INFO: `/v3/projects/f95f1d550ec24369b71aa2b7505fa16a/users/f0e58612e995496cb5ac8ad1b2612c00/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.649954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95f1d550ec24369b71aa2b7505fa16a, user_id=f0e58612e995496cb5ac8ad1b2612c00, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:20.653345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.777177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 869/1727] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:20 2022] PUT /identity/v3/projects/f95f1d550ec24369b71aa2b7505fa16a/users/f0e58612e995496cb5ac8ad1b2612c00/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:20.789923 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93381ab5-0a4c-4af9-a8cd-131149f1e58f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.790307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93381ab5-0a4c-4af9-a8cd-131149f1e58f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.790589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93381ab5-0a4c-4af9-a8cd-131149f1e58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.845174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-93381ab5-0a4c-4af9-a8cd-131149f1e58f None None] MFA Rules not processed for user `f0e58612e995496cb5ac8ad1b2612c00`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:20.846520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-93381ab5-0a4c-4af9-a8cd-131149f1e58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:20.983728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 859/1728] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:20.988399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.109221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd900-8cf7-4663-8626-ad34edde7330 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.113949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.118250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.118734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.119171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.120118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.122821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.231459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 870/1729] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:20 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:21.235537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93381ab5-0a4c-4af9-a8cd-131149f1e58f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.248785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93381ab5-0a4c-4af9-a8cd-131149f1e58f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.323326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.324353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.324684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.325006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.326103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.328243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.468055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.468993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 860/1730] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:21 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:21.480296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b0399-9912-4873-97c2-0997bc2ab4f7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.490934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.493035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.493035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.493832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.495124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.497202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.515894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.527212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 871/1731] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:19:21.536228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e181a-af5e-446e-9a59-fd5dcd5c2878 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.540140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.541506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.542002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.542422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] PATH_INFO: `/v3/projects/375f24cb65f4437a90a81f840ef3bc8b/users/c77177b5f0f84b9b876a06960fdd12e0/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.564633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375f24cb65f4437a90a81f840ef3bc8b, user_id=c77177b5f0f84b9b876a06960fdd12e0, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.568322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.704292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.714816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 861/1732] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:21 2022] PUT /identity/v3/projects/375f24cb65f4437a90a81f840ef3bc8b/users/c77177b5f0f84b9b876a06960fdd12e0/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:21.719395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3f820-032f-4c91-b673-20bd4da869ce admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.816058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6638c7-4993-4a5e-8b29-de93c656eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.817531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6638c7-4993-4a5e-8b29-de93c656eb29 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.817833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6638c7-4993-4a5e-8b29-de93c656eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.818118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6638c7-4993-4a5e-8b29-de93c656eb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.819479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6638c7-4993-4a5e-8b29-de93c656eb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.823329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6638c7-4993-4a5e-8b29-de93c656eb29 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.842539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 872/1733] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:21.844196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.864646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6957-f716-46e4-8d05-6dfee6ee5945 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.880122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.884265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.886924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.888149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] PATH_INFO: `/v3/projects/375f24cb65f4437a90a81f840ef3bc8b/users/c77177b5f0f84b9b876a06960fdd12e0/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.893089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=375f24cb65f4437a90a81f840ef3bc8b, user_id=c77177b5f0f84b9b876a06960fdd12e0, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.898879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.927511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.928296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.928428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 862/1734] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:21 2022] PUT /identity/v3/projects/375f24cb65f4437a90a81f840ef3bc8b/users/c77177b5f0f84b9b876a06960fdd12e0/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:21.928544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.965031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] MFA Rules not processed for user `c77177b5f0f84b9b876a06960fdd12e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:21.966428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:22.064320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 873/1735] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:22.078626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:22.084252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:22.164254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd7a9d-40b8-46cd-94bd-ec70555727fc admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:22.169408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9460d-1621-4cd4-b1c6-a3ffb060df18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:22.170488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9460d-1621-4cd4-b1c6-a3ffb060df18 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:22.170927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9460d-1621-4cd4-b1c6-a3ffb060df18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:22.171298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9460d-1621-4cd4-b1c6-a3ffb060df18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:22.196392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9460d-1621-4cd4-b1c6-a3ffb060df18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:22.198232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9460d-1621-4cd4-b1c6-a3ffb060df18 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:22.212515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 863/1736] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:25.064459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:25.064459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:25.167876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2008-a0f0-4aca-afc8-2067082f1e5c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:25.173240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:25.174388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:25.174674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:25.174973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] PATH_INFO: `/v3/users/35299e0dd06d4e0abc287f787a111309` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:25.176217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=35299e0dd06d4e0abc287f787a111309)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:25.178251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:25.455676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35299e0dd06d4e0abc287f787a111309'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:25.459596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35299e0dd06d4e0abc287f787a111309'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:25.481581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35299e0dd06d4e0abc287f787a111309'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:25.599100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35299e0dd06d4e0abc287f787a111309'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:25.599921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35299e0dd06d4e0abc287f787a111309'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:25.626794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 874/1737] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:25 2022] DELETE /identity/v3/users/35299e0dd06d4e0abc287f787a111309 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:25.628088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:25.628568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:25.628664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:25.654084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:25.655440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:25.723534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 864/1738] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:25.734386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:25.736162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:25.817428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ad05d-5f19-4054-880b-ed8c43e737bd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:25.823442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:25.824167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:25.824451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:25.824726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:25.836779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:25.838435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:25.849248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 875/1739] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:26.472593 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.474171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:26.488284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca318c8e-5b50-4849-909b-0185840b6d5a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.493549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.494489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.494838 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.495178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] PATH_INFO: `/v3/users/f0e58612e995496cb5ac8ad1b2612c00` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.496661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e58612e995496cb5ac8ad1b2612c00)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.498815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.736524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.738077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:26.747365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e58612e995496cb5ac8ad1b2612c00'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:26.748234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e58612e995496cb5ac8ad1b2612c00'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:26.765646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a5da6-24c3-4d70-b6ed-69ca1b1eacf9 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.774796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.776005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.776005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.776195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] PATH_INFO: `/v3/projects/7ff5c849c806432a9e7b8fbaebad909c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.777732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff5c849c806432a9e7b8fbaebad909c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.780117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.852431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e58612e995496cb5ac8ad1b2612c00'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:26.867766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e58612e995496cb5ac8ad1b2612c00'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:26.868535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-23a2c711-cd6f-4c75-a4c3-6534eba65dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e58612e995496cb5ac8ad1b2612c00'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:26.880749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 865/1740] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:26 2022] DELETE /identity/v3/users/f0e58612e995496cb5ac8ad1b2612c00 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:26.885527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.885990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.886525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.912852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:26.921473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:26.934274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff5c849c806432a9e7b8fbaebad909c', 'request_id': 'req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:26.996725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 866/1741] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:27.003447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:27.004852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:27.028028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff5c849c806432a9e7b8fbaebad909c', 'request_id': 'req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.036080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff5c849c806432a9e7b8fbaebad909c', 'request_id': 'req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.081599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] The token cache is being invalidate because project 7ff5c849c806432a9e7b8fbaebad909c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:27.081905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.096292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.108271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 876/1742] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:26 2022] DELETE /identity/v3/projects/7ff5c849c806432a9e7b8fbaebad909c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:27.114718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:27.118463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:27.150433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ba661-980a-42b6-a2be-7ccd3ce368b4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:27.159633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:27.160606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:27.161103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:27.161522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] PATH_INFO: `/v3/users/16647292178b4b109ad01ee399870d5e` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:27.163205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=16647292178b4b109ad01ee399870d5e)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:27.167982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:27.175971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d0dd6-4640-42fb-acc8-c283a1a906ce None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:27.183220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:27.184781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:27.186743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:27.187202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:27.190657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:27.207039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:27.209001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:27.221511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 867/1743] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:27.454481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16647292178b4b109ad01ee399870d5e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.455680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16647292178b4b109ad01ee399870d5e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.492819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16647292178b4b109ad01ee399870d5e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.581508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16647292178b4b109ad01ee399870d5e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.582699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16647292178b4b109ad01ee399870d5e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:27.603867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 877/1744] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:27 2022] DELETE /identity/v3/users/16647292178b4b109ad01ee399870d5e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:28.093902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:28.111668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31377f86-423a-4558-bc25-5602cc051418 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:28.200364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:28.202015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:28.202514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:28.202943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] PATH_INFO: `/v3/projects/5295d50e952a41419664028834b6afd2` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:28.204254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5295d50e952a41419664028834b6afd2)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:28.206439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:28.233832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:28.235780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:28.250062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819c45e-4318-4e78-8761-555b004125ad admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:28.274139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:28.274938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:28.275415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:28.275704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] PATH_INFO: `/v3/projects/f95f1d550ec24369b71aa2b7505fa16a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:28.279139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95f1d550ec24369b71aa2b7505fa16a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:28.281227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:28.364386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5295d50e952a41419664028834b6afd2', 'request_id': 'req-c4f2749b-4ef1-48a2-a728-863210484356'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.463734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95f1d550ec24369b71aa2b7505fa16a', 'request_id': 'req-ef8da6a7-a59a-45fd-954e-26472dad677f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.473046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5295d50e952a41419664028834b6afd2', 'request_id': 'req-c4f2749b-4ef1-48a2-a728-863210484356'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.482774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5295d50e952a41419664028834b6afd2', 'request_id': 'req-c4f2749b-4ef1-48a2-a728-863210484356'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.500113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] The token cache is being invalidate because project 5295d50e952a41419664028834b6afd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:28.500408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.501318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.503190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 868/1745] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:28 2022] DELETE /identity/v3/projects/5295d50e952a41419664028834b6afd2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:28.508603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:28.510405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:28.592496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95f1d550ec24369b71aa2b7505fa16a', 'request_id': 'req-ef8da6a7-a59a-45fd-954e-26472dad677f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.599086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95f1d550ec24369b71aa2b7505fa16a', 'request_id': 'req-ef8da6a7-a59a-45fd-954e-26472dad677f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.599807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2749b-4ef1-48a2-a728-863210484356 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:28.612844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] The token cache is being invalidate because project f95f1d550ec24369b71aa2b7505fa16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:28.613210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.614906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.618256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 878/1746] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:28 2022] DELETE /identity/v3/projects/f95f1d550ec24369b71aa2b7505fa16a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:28.622428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:28.625820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:28.667751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:28.668626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:28.668908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:28.669548 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] PATH_INFO: `/v3/users/d36d551e9149495b8db35a6fb8f3d91d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:28.670935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36d551e9149495b8db35a6fb8f3d91d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:28.673052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:28.728086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8da6a7-a59a-45fd-954e-26472dad677f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:28.732727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:28.733652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:28.733930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:28.734198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] PATH_INFO: `/v3/users/c77177b5f0f84b9b876a06960fdd12e0` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:28.735759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77177b5f0f84b9b876a06960fdd12e0)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:28.737744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:28.939219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36d551e9149495b8db35a6fb8f3d91d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.940097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36d551e9149495b8db35a6fb8f3d91d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.990701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77177b5f0f84b9b876a06960fdd12e0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:28.991373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77177b5f0f84b9b876a06960fdd12e0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:29.003518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77177b5f0f84b9b876a06960fdd12e0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:29.015721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36d551e9149495b8db35a6fb8f3d91d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:29.031606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36d551e9149495b8db35a6fb8f3d91d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:29.032735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36d551e9149495b8db35a6fb8f3d91d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:29.049675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 869/1747] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:28 2022] DELETE /identity/v3/users/d36d551e9149495b8db35a6fb8f3d91d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:29.089803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77177b5f0f84b9b876a06960fdd12e0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:29.090426 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77177b5f0f84b9b876a06960fdd12e0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:29.103997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 879/1748] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:28 2022] DELETE /identity/v3/users/c77177b5f0f84b9b876a06960fdd12e0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:29.775449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.777268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:29.818934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.821086 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:29.897594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049c5a1-c6b1-4432-bb3e-26f48d20832c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.939183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c73c6-34f4-4a4e-af4b-8f200d0cfa2b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.946412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.948632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.949488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.950569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] PATH_INFO: `/v3/projects/4279bb2c18b94bd8a6d7b3b70fd7cea4` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.952304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4279bb2c18b94bd8a6d7b3b70fd7cea4)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.955339 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.966324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.969225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.969225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.969225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] PATH_INFO: `/v3/projects/375f24cb65f4437a90a81f840ef3bc8b` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.969225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375f24cb65f4437a90a81f840ef3bc8b)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.971440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.138661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375f24cb65f4437a90a81f840ef3bc8b', 'request_id': 'req-02617580-0159-4125-b825-26cdf9367f68'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.141184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4279bb2c18b94bd8a6d7b3b70fd7cea4', 'request_id': 'req-fdcce6fa-fb93-4851-bd5a-c415f8c03165'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.284189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375f24cb65f4437a90a81f840ef3bc8b', 'request_id': 'req-02617580-0159-4125-b825-26cdf9367f68'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.291233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375f24cb65f4437a90a81f840ef3bc8b', 'request_id': 'req-02617580-0159-4125-b825-26cdf9367f68'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.301323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] The token cache is being invalidate because project 375f24cb65f4437a90a81f840ef3bc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:30.301600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.302229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-02617580-0159-4125-b825-26cdf9367f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.303739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 870/1749] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:29 2022] DELETE /identity/v3/projects/375f24cb65f4437a90a81f840ef3bc8b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:30.305015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe489d-3571-4690-84a6-27151a11cd9e None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.305325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe489d-3571-4690-84a6-27151a11cd9e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.305604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe489d-3571-4690-84a6-27151a11cd9e None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.307231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 871/1750] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:30.308261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c954-1846-4991-a5b5-8ca9b3b0e380 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.308539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c954-1846-4991-a5b5-8ca9b3b0e380 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.308809 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01c954-1846-4991-a5b5-8ca9b3b0e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.326714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-4c01c954-1846-4991-a5b5-8ca9b3b0e380 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:30.327944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4c01c954-1846-4991-a5b5-8ca9b3b0e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:30.375478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4279bb2c18b94bd8a6d7b3b70fd7cea4', 'request_id': 'req-fdcce6fa-fb93-4851-bd5a-c415f8c03165'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.383465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4279bb2c18b94bd8a6d7b3b70fd7cea4', 'request_id': 'req-fdcce6fa-fb93-4851-bd5a-c415f8c03165'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.393698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 872/1751] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:30.395019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09b19-f6ac-4823-acf2-64d3eb2f12c8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.395311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09b19-f6ac-4823-acf2-64d3eb2f12c8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.395590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d09b19-f6ac-4823-acf2-64d3eb2f12c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.402532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] The token cache is being invalidate because project 4279bb2c18b94bd8a6d7b3b70fd7cea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:30.402959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.403624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fdcce6fa-fb93-4851-bd5a-c415f8c03165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:30.405250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 880/1752] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:29 2022] DELETE /identity/v3/projects/4279bb2c18b94bd8a6d7b3b70fd7cea4 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:30.406603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c4f0-d710-408d-be60-80fb7073d997 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.406959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c4f0-d710-408d-be60-80fb7073d997 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.407359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c4f0-d710-408d-be60-80fb7073d997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.420016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-17d09b19-f6ac-4823-acf2-64d3eb2f12c8 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:30.420016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-17d09b19-f6ac-4823-acf2-64d3eb2f12c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:30.426688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6f97c4f0-d710-408d-be60-80fb7073d997 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:30.427870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6f97c4f0-d710-408d-be60-80fb7073d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:30.437525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 881/1753] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:30.438614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e899e6-2ed4-4ce2-9811-d4cacef0d4d8 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.438900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e899e6-2ed4-4ce2-9811-d4cacef0d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.439176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e899e6-2ed4-4ce2-9811-d4cacef0d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.459912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-92e899e6-2ed4-4ce2-9811-d4cacef0d4d8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:30.461821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-92e899e6-2ed4-4ce2-9811-d4cacef0d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:30.474909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 882/1754] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:30.478523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e899e6-2ed4-4ce2-9811-d4cacef0d4d8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.489210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e899e6-2ed4-4ce2-9811-d4cacef0d4d8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.494440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.495168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.495541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.495841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.496569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:30.496868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.498514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.500092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 873/1755] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:30.502762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2105-0e8f-4759-b3b6-69b4afd0a609 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.503236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2105-0e8f-4759-b3b6-69b4afd0a609 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.503997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa2105-0e8f-4759-b3b6-69b4afd0a609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.510552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 883/1756] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:30.513316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.514517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:30.524462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f7aa2105-0e8f-4759-b3b6-69b4afd0a609 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:30.525671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f7aa2105-0e8f-4759-b3b6-69b4afd0a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:30.532684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4b1e5-5866-42fe-af61-4a8d837d4425 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.533789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 874/1757] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:30.537504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2105-0e8f-4759-b3b6-69b4afd0a609 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.538208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.538890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.539173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.539447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.546965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa2105-0e8f-4759-b3b6-69b4afd0a609 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.549182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.550799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.551841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.552626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.553027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.553332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.554589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.557694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.561993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 884/1758] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:30.562892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.574012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344253-4c8a-41f0-92dd-7eb267d3cf64 service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.578874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.579671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.579952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.580231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.586437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:30.586437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.586437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.595488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 885/1759] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:30.599929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.615870 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49fdc9-4ec5-40cb-a4df-8752f6639faf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.624798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.625742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.626035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.626442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.627197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.629110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.669392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 875/1760] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:30.670659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.673966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:30.731508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 886/1761] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:30.735441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.738738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee4c7-f06b-4889-b056-161486304f85 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.816177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1cd05-3774-41a0-86dc-c3a5317faa4d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.822739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.824895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.834366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.834988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.836008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.839275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.851854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.855311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.855651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.855929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] PATH_INFO: `/v3/users/6f6a2679757846ccbc4c559da3564994` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.857498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6a2679757846ccbc4c559da3564994)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.860695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:30.925858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 887/1762] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:30.925858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:30.933964 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44aada-f293-46ca-a9ef-0142e83ee231 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:30.938775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:30.939918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:30.939918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:30.940253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:30.942131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:30.944205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.056989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6a2679757846ccbc4c559da3564994'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:31.058187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6a2679757846ccbc4c559da3564994'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:31.063645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 888/1763] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:30 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:31.064480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.078548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083983-9660-4142-ae0e-a44f5673c323 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.084167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.085074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.085435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.085694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.096993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.101401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.120150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 889/1764] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:31.121215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.138810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75525fe6-c79e-4f1b-99ca-a7b8d2e08a87 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.143736 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.144402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.144683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.144959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.145747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.147330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.158418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 890/1765] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:31.159459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.170930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a211d75-021c-4519-8f26-d6178bd7565f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.175321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.176034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.176264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.176572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.177329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.178938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.186830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6a2679757846ccbc4c559da3564994'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:31.192149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 891/1766] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:31.192149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.201492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6a2679757846ccbc4c559da3564994'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:31.202655 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6a2679757846ccbc4c559da3564994'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:31.203226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc11d9e-a1f8-49bd-878e-11f0907ef3ce admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.208304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419f51e-b9fb-4359-94e0-5fb5856208bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.209002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f51e-b9fb-4359-94e0-5fb5856208bc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.209324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f51e-b9fb-4359-94e0-5fb5856208bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.209596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419f51e-b9fb-4359-94e0-5fb5856208bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.210866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419f51e-b9fb-4359-94e0-5fb5856208bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.212462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419f51e-b9fb-4359-94e0-5fb5856208bc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.221955 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 876/1767] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:30 2022] DELETE /identity/v3/users/6f6a2679757846ccbc4c559da3564994 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:31.223081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.223311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 892/1768] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:31.225631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:31.226688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.227067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.227353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.245830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:31.247042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:31.306415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57918fd-a077-40b3-9766-2081806345c1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.311685 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.312587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.312860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.313136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] PATH_INFO: `/v3/projects/65e78c3d9472411e9c5b139e42c996d1/users/45cd64bef6d548da981d39981a76f800/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.319889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 893/1769] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:31.322653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.324844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:31.329092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e78c3d9472411e9c5b139e42c996d1, user_id=45cd64bef6d548da981d39981a76f800, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.331790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.339511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe31c2-5ccc-4191-b46c-a49aeb201a98 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.345587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e1b62-180f-4ba3-acde-9f3535c7fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.346480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e1b62-180f-4ba3-acde-9f3535c7fd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.346759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e1b62-180f-4ba3-acde-9f3535c7fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.347028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e1b62-180f-4ba3-acde-9f3535c7fd5d admin admin] PATH_INFO: `/v3/projects/1ef7a227ea3b46fb8dd4a8777829b481/users/e5156c2dca51491e8c928fa4dc6e8517/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.362756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e1b62-180f-4ba3-acde-9f3535c7fd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef7a227ea3b46fb8dd4a8777829b481, user_id=e5156c2dca51491e8c928fa4dc6e8517, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.365452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e1b62-180f-4ba3-acde-9f3535c7fd5d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.452906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 877/1770] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:31 2022] PUT /identity/v3/projects/65e78c3d9472411e9c5b139e42c996d1/users/45cd64bef6d548da981d39981a76f800/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:31.452906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.452906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:31.473150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 894/1771] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:31 2022] PUT /identity/v3/projects/1ef7a227ea3b46fb8dd4a8777829b481/users/e5156c2dca51491e8c928fa4dc6e8517/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:31.475280 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d12a7-81e9-4e67-9fd2-6118a4142d33 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.475280 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d12a7-81e9-4e67-9fd2-6118a4142d33 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.475499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d12a7-81e9-4e67-9fd2-6118a4142d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.505580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ca9d12a7-81e9-4e67-9fd2-6118a4142d33 None None] MFA Rules not processed for user `45cd64bef6d548da981d39981a76f800`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:31.506740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ca9d12a7-81e9-4e67-9fd2-6118a4142d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:31.509086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f5098-17ab-44e4-8eb8-31297845ed52 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.579347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.580020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.580504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.580794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.597149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 895/1772] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:31.599302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cacda-cf26-474e-973c-6421f81262ee None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.599958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cacda-cf26-474e-973c-6421f81262ee None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.600439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cacda-cf26-474e-973c-6421f81262ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.651786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6a3cacda-cf26-474e-973c-6421f81262ee None None] MFA Rules not processed for user `e5156c2dca51491e8c928fa4dc6e8517`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:31.653551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6a3cacda-cf26-474e-973c-6421f81262ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:31.671889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.674077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.687631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 878/1773] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:31.689408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.701713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81aa0f7-1562-4100-94f8-636d11b39e8f service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.710252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.711183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.712200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.712995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.714077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.717143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.742071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 896/1774] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:31.746808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cacda-cf26-474e-973c-6421f81262ee None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.762099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cacda-cf26-474e-973c-6421f81262ee None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.767726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.768729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.769019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.769945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.770679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.773268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.838349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 879/1775] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:31.839340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.891362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 897/1776] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:31.895304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.900105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31982f7d-9cdd-44bc-810e-9865a9277dc5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.957233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.957931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.958265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.958483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.959288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.961866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.965554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da807-fb17-42e4-8bcb-ef1abe0cecf4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.972330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.973164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.974105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.974397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.975339 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.978446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.082913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 880/1777] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:32.083965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.095372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6966-36e0-4738-8be1-f230b5aca8bf admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.100384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.101724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.102108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.102464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.103656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.105529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.119536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 898/1778] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:32.121725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.125336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 881/1779] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:32.129927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.132382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9ce4c-2631-410d-b0f3-028727f27b49 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.145111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.145919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.146272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.146554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.147387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.150598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.151941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c220eb-e3f7-4416-9be8-2b6adf4abb70 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.161847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 899/1780] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:32.165778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.167417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.167963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.168242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.170790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.170790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.171645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.179925 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71b44-57fe-496a-9eb6-3570964af309 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.187604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.188719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.188849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 882/1781] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:32.189427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.190011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] PATH_INFO: `/v3/projects/ea1caeba8bd0474eae41968aebb45f66/users/8335cc7d4d2a42e88d2860dcd60e16a5/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.193366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.212197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6302-d03c-4ed9-8d55-79b72571768c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.221524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1caeba8bd0474eae41968aebb45f66, user_id=8335cc7d4d2a42e88d2860dcd60e16a5, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.221864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.222965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.223506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.223830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] PATH_INFO: `/v3/projects/70ab38fc8f184f509239944ac7677bb8/users/976f3f055b1d4a4cadbf726a5672b90a/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.226582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.245574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ab38fc8f184f509239944ac7677bb8, user_id=976f3f055b1d4a4cadbf726a5672b90a, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.248826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.344149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 900/1782] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:32 2022] PUT /identity/v3/projects/ea1caeba8bd0474eae41968aebb45f66/users/8335cc7d4d2a42e88d2860dcd60e16a5/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:32.344149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.348753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:32.358938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 883/1783] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:32 2022] PUT /identity/v3/projects/70ab38fc8f184f509239944ac7677bb8/users/976f3f055b1d4a4cadbf726a5672b90a/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:32.359783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.429572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d7a42-6137-4cb2-929f-cd333986a063 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.462925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96a4c7-24c5-4f8a-97e5-937fca3fe6f3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.479942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb28ce-7bce-47e9-a8a5-211abe09d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.483071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb28ce-7bce-47e9-a8a5-211abe09d9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.483071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb28ce-7bce-47e9-a8a5-211abe09d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.483071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb28ce-7bce-47e9-a8a5-211abe09d9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.484073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb28ce-7bce-47e9-a8a5-211abe09d9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.487762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb28ce-7bce-47e9-a8a5-211abe09d9a2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.502741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 884/1784] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:32.508175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70887-a074-4b80-b579-7537bc2456da None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.508469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70887-a074-4b80-b579-7537bc2456da None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.508753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70887-a074-4b80-b579-7537bc2456da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.518705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.519575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.519858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.523594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] PATH_INFO: `/v3/projects/681de655d34e45fab71f9552227617bf` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.523594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=681de655d34e45fab71f9552227617bf)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.524399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.551029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-ddd70887-a074-4b80-b579-7537bc2456da None None] MFA Rules not processed for user `976f3f055b1d4a4cadbf726a5672b90a`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:32.553558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ddd70887-a074-4b80-b579-7537bc2456da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:32.631689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 885/1785] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:32.633032 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd70887-a074-4b80-b579-7537bc2456da None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.642954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd70887-a074-4b80-b579-7537bc2456da None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.647386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.649802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.650295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.650538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] PATH_INFO: `/v3/projects/ea1caeba8bd0474eae41968aebb45f66/users/8335cc7d4d2a42e88d2860dcd60e16a5/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.652604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1caeba8bd0474eae41968aebb45f66, user_id=8335cc7d4d2a42e88d2860dcd60e16a5, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.655436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.674896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 886/1786] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:32 2022] PUT /identity/v3/projects/ea1caeba8bd0474eae41968aebb45f66/users/8335cc7d4d2a42e88d2860dcd60e16a5/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:32.688846 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.693774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681de655d34e45fab71f9552227617bf', 'request_id': 'req-07732408-da81-4a63-b422-eab4669554b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:32.767416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea09409-627c-4abc-89c2-20d35fb30a36 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.810608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681de655d34e45fab71f9552227617bf', 'request_id': 'req-07732408-da81-4a63-b422-eab4669554b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:32.823128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681de655d34e45fab71f9552227617bf', 'request_id': 'req-07732408-da81-4a63-b422-eab4669554b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:32.826937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a82ed9-5421-4c6e-9555-60ea1a5ed7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.828050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82ed9-5421-4c6e-9555-60ea1a5ed7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.828279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82ed9-5421-4c6e-9555-60ea1a5ed7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.828635 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a82ed9-5421-4c6e-9555-60ea1a5ed7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.829659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a82ed9-5421-4c6e-9555-60ea1a5ed7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.832418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a82ed9-5421-4c6e-9555-60ea1a5ed7c9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.856671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] The token cache is being invalidate because project 681de655d34e45fab71f9552227617bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:32.857118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:32.857892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-07732408-da81-4a63-b422-eab4669554b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:32.863554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 901/1787] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:32 2022] DELETE /identity/v3/projects/681de655d34e45fab71f9552227617bf => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:32.863554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.863554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.863554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.892848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] MFA Rules not processed for user `8335cc7d4d2a42e88d2860dcd60e16a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:32.894103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:32.944066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 887/1788] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:32 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:32.954463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.954933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.955359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.974914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 902/1789] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:32.978550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.982886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:32.982995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:32.982995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:32.999798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa741255-a08d-4250-a410-edf76b2489ea None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.065168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 888/1790] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:33.066046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.067303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:33.075493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bf85f-a521-477a-a658-eedf87ff3a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.076228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf85f-a521-477a-a658-eedf87ff3a2f admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.076528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf85f-a521-477a-a658-eedf87ff3a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.076834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bf85f-a521-477a-a658-eedf87ff3a2f admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.077561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bf85f-a521-477a-a658-eedf87ff3a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.079529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bf85f-a521-477a-a658-eedf87ff3a2f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.131085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa35931-5caa-4097-9210-5e7680da2c3f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.135915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.136562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.136875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.137155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.205563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 903/1791] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:32 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:33.207167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c6c6-36fb-4ca0-a652-93ed2f0fa5f5 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.207619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c6c6-36fb-4ca0-a652-93ed2f0fa5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.208372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c6c6-36fb-4ca0-a652-93ed2f0fa5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.228043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.228043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.236186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a956c6c6-36fb-4ca0-a652-93ed2f0fa5f5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:33.237957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a956c6c6-36fb-4ca0-a652-93ed2f0fa5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:33.239487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 889/1792] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:33.240386 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.251059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ccac-1742-449f-98fc-af453eb7c3ed service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.253370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 904/1793] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:33.257924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c6c6-36fb-4ca0-a652-93ed2f0fa5f5 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.271764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c6c6-36fb-4ca0-a652-93ed2f0fa5f5 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.283130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.284229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.284696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.285233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.286486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:33.286971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.288007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.289416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.289689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.289812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.289991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.291249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.295690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.310453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 905/1794] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:33.314879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.318454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 890/1795] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:33.322982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.326884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e34469-5bab-466f-88f8-588d8cd9b7ca admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.332685 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.333431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.334061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.334061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.335206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.337146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.337401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538ef0c-545f-4685-99f9-1426aa808ff9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.342918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.343801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.344082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.344424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] PATH_INFO: `/v3/projects/70d8410454cb49ce8faea5dc3f080ed6/users/eab7ffe869b0420eaf4ae767243a23ba/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.362863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d8410454cb49ce8faea5dc3f080ed6, user_id=eab7ffe869b0420eaf4ae767243a23ba, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.369248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.479774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 906/1796] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:33 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:33.485818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.506827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 891/1797] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:33 2022] PUT /identity/v3/projects/70d8410454cb49ce8faea5dc3f080ed6/users/eab7ffe869b0420eaf4ae767243a23ba/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:33.510102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.617876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe77520-8160-4e59-8d4a-31f130692680 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.635347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b32c4b-5a9f-43bd-94f6-09d29e0de298 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.640728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.641466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.641751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.642600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.643349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.645098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.657261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 892/1798] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:33.664933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.710770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.711541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.711831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.712204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.713091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.715278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.722992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd54941-1b7d-45f9-b882-8e02c9f541f0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.739642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c4a38-8246-412f-9308-978163ff3eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.740664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4a38-8246-412f-9308-978163ff3eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.741038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4a38-8246-412f-9308-978163ff3eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.741926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c4a38-8246-412f-9308-978163ff3eb2 admin admin] PATH_INFO: `/v3/projects/70d8410454cb49ce8faea5dc3f080ed6/users/eab7ffe869b0420eaf4ae767243a23ba/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.744398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c4a38-8246-412f-9308-978163ff3eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d8410454cb49ce8faea5dc3f080ed6, user_id=eab7ffe869b0420eaf4ae767243a23ba, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.747349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c4a38-8246-412f-9308-978163ff3eb2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.769727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 893/1799] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:33 2022] PUT /identity/v3/projects/70d8410454cb49ce8faea5dc3f080ed6/users/eab7ffe869b0420eaf4ae767243a23ba/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:33.779315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a0c7-bd76-4988-aa73-79f5ce813f51 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.779607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a0c7-bd76-4988-aa73-79f5ce813f51 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.779872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4a0c7-bd76-4988-aa73-79f5ce813f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.818230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-00a4a0c7-bd76-4988-aa73-79f5ce813f51 None None] MFA Rules not processed for user `eab7ffe869b0420eaf4ae767243a23ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:33.820129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-00a4a0c7-bd76-4988-aa73-79f5ce813f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:33.831894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 907/1800] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:33 2022] POST /identity/v3/users => generated 282 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:33.833150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.855546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cce5a-6586-48e1-876b-983042374a32 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.910684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 894/1801] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:33.921051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a0c7-bd76-4988-aa73-79f5ce813f51 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.927017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.927547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.928319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.928319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.928873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.931240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.945215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 908/1802] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:19:33.950568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:33.965875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8e06-bd45-4e29-b8ed-3d448fa1932c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:33.986700 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:33.987473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:33.988101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:33.988480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:33.990607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:33.993627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:33.995784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4a0c7-bd76-4988-aa73-79f5ce813f51 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.006387 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.007189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.007551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.007906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.015935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 909/1803] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:34.016812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.018721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:34.029238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.029238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.032504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 895/1804] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:34.034892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.038090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba28093-5476-469d-933a-d5cad7373600 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.043825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.044829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.045117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.045513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] PATH_INFO: `/v3/users/e5156c2dca51491e8c928fa4dc6e8517` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.046915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5156c2dca51491e8c928fa4dc6e8517)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.048880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.056983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604fddc-3b49-48ce-b2da-d0695868e9e9 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.063481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e459c-7639-4523-abfe-3f75ec368727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.064675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e459c-7639-4523-abfe-3f75ec368727 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.064962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e459c-7639-4523-abfe-3f75ec368727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.066230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e459c-7639-4523-abfe-3f75ec368727 admin admin] PATH_INFO: `/v3/projects/5a911b3509574a7bb421f9248ecddbc6/users/796b66fe4d8b4b52b4078a2bca9ba688/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.085430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e459c-7639-4523-abfe-3f75ec368727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a911b3509574a7bb421f9248ecddbc6, user_id=796b66fe4d8b4b52b4078a2bca9ba688, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.087800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e459c-7639-4523-abfe-3f75ec368727 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.210196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 896/1805] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:34 2022] PUT /identity/v3/projects/5a911b3509574a7bb421f9248ecddbc6/users/796b66fe4d8b4b52b4078a2bca9ba688/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:34.220324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af077e5-c005-457d-9a1f-c43a3397a482 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.220614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af077e5-c005-457d-9a1f-c43a3397a482 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.220904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af077e5-c005-457d-9a1f-c43a3397a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.248346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-7af077e5-c005-457d-9a1f-c43a3397a482 None None] MFA Rules not processed for user `796b66fe4d8b4b52b4078a2bca9ba688`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:34.249617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7af077e5-c005-457d-9a1f-c43a3397a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:34.253657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5156c2dca51491e8c928fa4dc6e8517'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:34.254430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5156c2dca51491e8c928fa4dc6e8517'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:34.266590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5156c2dca51491e8c928fa4dc6e8517'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:34.315225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 897/1806] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:34.320249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af077e5-c005-457d-9a1f-c43a3397a482 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.369628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5156c2dca51491e8c928fa4dc6e8517'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:34.370512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e5485431-7d53-41a6-bb27-b4d8b96c124e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5156c2dca51491e8c928fa4dc6e8517'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:34.383267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af077e5-c005-457d-9a1f-c43a3397a482 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.383897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 910/1807] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:34 2022] DELETE /identity/v3/users/e5156c2dca51491e8c928fa4dc6e8517 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:34.388109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.388396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.388671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.406469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:34.407660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:34.437477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.438125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.438402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.438677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.439371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.441256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.466108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 911/1808] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:34.475607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.476997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:34.543604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964fac8-fb25-4677-8bae-52cb564e1f8e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.547725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.548503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.548793 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.557768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.562410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.566048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.566595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 898/1809] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:34 2022] POST /identity/v3/projects => generated 361 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:34.567900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.570930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:34.576680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 912/1810] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:34.661716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c79a-4891-4596-b575-ec40a7a6fbc5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.669245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.670214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.670630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.671029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.671926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.674156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.784447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 899/1811] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:34 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:34.785576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.794979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6117a-1a62-4f13-b36e-2a53a7c6d619 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.799682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.800329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.800614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.800889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.801657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.803645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.815082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 913/1812] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:19:34.823577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.834237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300922dd-1313-453d-8955-0b7a882b948e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.839868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.840967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.841113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.841427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] PATH_INFO: `/v3/projects/4476126a7c5c4a3bbaf185fd807b20ef/users/f59b23dd3434428e8e6cbfb82497d346/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.858601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4476126a7c5c4a3bbaf185fd807b20ef, user_id=f59b23dd3434428e8e6cbfb82497d346, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.861556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.988270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 900/1813] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:34 2022] PUT /identity/v3/projects/4476126a7c5c4a3bbaf185fd807b20ef/users/f59b23dd3434428e8e6cbfb82497d346/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:34.992703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.011433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53bf7f-0327-4ac5-aac6-1acea62ad7f7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.078337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c01d9-0de0-47d6-8da0-51f72517440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.079081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c01d9-0de0-47d6-8da0-51f72517440e admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.085498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c01d9-0de0-47d6-8da0-51f72517440e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.085498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c01d9-0de0-47d6-8da0-51f72517440e admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.091217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c01d9-0de0-47d6-8da0-51f72517440e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.094029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c01d9-0de0-47d6-8da0-51f72517440e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.116186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 914/1814] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:19:35.120964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.149737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283e14d-dbcd-4018-ba12-bc8638227f5b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.156656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.157860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.158204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.158959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] PATH_INFO: `/v3/projects/4476126a7c5c4a3bbaf185fd807b20ef/users/f59b23dd3434428e8e6cbfb82497d346/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.162628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4476126a7c5c4a3bbaf185fd807b20ef, user_id=f59b23dd3434428e8e6cbfb82497d346, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.167587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.184702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 901/1815] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:35 2022] PUT /identity/v3/projects/4476126a7c5c4a3bbaf185fd807b20ef/users/f59b23dd3434428e8e6cbfb82497d346/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:35.196821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.197123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.197474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.257590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] MFA Rules not processed for user `f59b23dd3434428e8e6cbfb82497d346`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:35.262696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:35.317470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.320528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:35.372382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 915/1816] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:35.385464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.390486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:35.499281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36246608-cc80-403d-8ad0-c2dd5877ddd3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.502241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260ce09-16b0-4007-a0a1-c648917020ca admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.505599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.506462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.507458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.507986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.514164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.516534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.517046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.517493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] PATH_INFO: `/v3/projects/1ef7a227ea3b46fb8dd4a8777829b481` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.519861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef7a227ea3b46fb8dd4a8777829b481)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.522133 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.522381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.524970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.536482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 916/1817] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:35.583632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.586434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:35.599732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da5354-6135-440f-8ad3-e374e4a48f38 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.604106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.604752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.605038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.605352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.607151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:35.667191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef7a227ea3b46fb8dd4a8777829b481', 'request_id': 'req-8c07490c-e6df-45b9-80fa-d54f566ce255'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:35.686202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.687646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.697167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 917/1818] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:35.746779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef7a227ea3b46fb8dd4a8777829b481', 'request_id': 'req-8c07490c-e6df-45b9-80fa-d54f566ce255'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:35.754109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef7a227ea3b46fb8dd4a8777829b481', 'request_id': 'req-8c07490c-e6df-45b9-80fa-d54f566ce255'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:35.767068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] The token cache is being invalidate because project 1ef7a227ea3b46fb8dd4a8777829b481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:35.767506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:35.768369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:35.772078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.773577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 902/1819] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:35 2022] DELETE /identity/v3/projects/1ef7a227ea3b46fb8dd4a8777829b481 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:35.774421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.775765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:35.780921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368f12-9fa0-4939-82b9-8d86534beb37 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.847948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.849134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.850198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.850627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.853340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:35.870850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07490c-e6df-45b9-80fa-d54f566ce255 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.875738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.876673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.876948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.877264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] PATH_INFO: `/v3/users/8335cc7d4d2a42e88d2860dcd60e16a5` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.878545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8335cc7d4d2a42e88d2860dcd60e16a5)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.880756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.923801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.925582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.935945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 918/1820] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:36.080629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8335cc7d4d2a42e88d2860dcd60e16a5'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:36.081811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8335cc7d4d2a42e88d2860dcd60e16a5'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:36.163786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8335cc7d4d2a42e88d2860dcd60e16a5'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:36.175890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8335cc7d4d2a42e88d2860dcd60e16a5'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:36.176576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d31bae73-adf0-4b02-b80d-f320cd80f771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8335cc7d4d2a42e88d2860dcd60e16a5'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:36.188463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 903/1821] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:35 2022] DELETE /identity/v3/users/8335cc7d4d2a42e88d2860dcd60e16a5 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:36.733354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:36.745864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29801491-cf31-4aff-b89e-29bb7a1333a8 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:36.840757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:36.841699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:36.841943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:36.842207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] PATH_INFO: `/v3/projects/ea1caeba8bd0474eae41968aebb45f66` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:36.843429 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1caeba8bd0474eae41968aebb45f66)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:36.845405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:36.992920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1caeba8bd0474eae41968aebb45f66', 'request_id': 'req-df030ab2-830b-4c07-9289-cc3300120f68'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:37.066664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1caeba8bd0474eae41968aebb45f66', 'request_id': 'req-df030ab2-830b-4c07-9289-cc3300120f68'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:37.073164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1caeba8bd0474eae41968aebb45f66', 'request_id': 'req-df030ab2-830b-4c07-9289-cc3300120f68'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:37.084690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] The token cache is being invalidate because project ea1caeba8bd0474eae41968aebb45f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:37.085020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:37.086242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-df030ab2-830b-4c07-9289-cc3300120f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:37.091888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 919/1822] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:36 2022] DELETE /identity/v3/projects/ea1caeba8bd0474eae41968aebb45f66 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:37.095744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c1b32-be15-456e-94f4-00d5b4356dae None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.096127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c1b32-be15-456e-94f4-00d5b4356dae None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.096474 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c1b32-be15-456e-94f4-00d5b4356dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.117599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-960c1b32-be15-456e-94f4-00d5b4356dae None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:37.118975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-960c1b32-be15-456e-94f4-00d5b4356dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:37.181908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 904/1823] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:37.190463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0996-abad-4dfc-aeaf-7b190eef076e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.190834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0996-abad-4dfc-aeaf-7b190eef076e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.191200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0996-abad-4dfc-aeaf-7b190eef076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.212057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-269c0996-abad-4dfc-aeaf-7b190eef076e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:37.213340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-269c0996-abad-4dfc-aeaf-7b190eef076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:37.221898 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 920/1824] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:37.226630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c1b32-be15-456e-94f4-00d5b4356dae None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.236924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c1b32-be15-456e-94f4-00d5b4356dae None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.242986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.243719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.244116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.244410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.245218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:37.245639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.247339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.264722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 905/1825] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:37.266035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c0996-abad-4dfc-aeaf-7b190eef076e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.278655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c0996-abad-4dfc-aeaf-7b190eef076e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.285409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.286092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.286362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.286641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.289088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.291660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.454829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 921/1826] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:37 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:37.455988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.466858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a6d93-bce2-42f5-a362-72639aa4fe1f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.537926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.539334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.539766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.540882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.541029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.543438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.634467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 906/1827] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:37 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:37.638727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.654490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3509f-6d52-45ff-8767-77af97658355 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.663385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.664181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.664538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.664886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.665739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.667635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.683833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 922/1828] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:37.685308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.715833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d28158-59a0-4b02-94b1-a38f625125e6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.722874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db9d28-6172-47de-905b-09b6b6716b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.723588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db9d28-6172-47de-905b-09b6b6716b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.723892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db9d28-6172-47de-905b-09b6b6716b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.724229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db9d28-6172-47de-905b-09b6b6716b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.725448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db9d28-6172-47de-905b-09b6b6716b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.729647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db9d28-6172-47de-905b-09b6b6716b5f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.746949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 907/1829] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:37.750743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.766166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499056-156a-4f9d-9a1f-5b48c02ee563 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.778874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.780126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.780782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.781488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] PATH_INFO: `/v3/projects/39ab59731df349d7920ca90d576df86a/users/429eb282b164412cb351d2745b80ed6a/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.799329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ab59731df349d7920ca90d576df86a, user_id=429eb282b164412cb351d2745b80ed6a, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.802453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.878614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 923/1830] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:37 2022] PUT /identity/v3/projects/39ab59731df349d7920ca90d576df86a/users/429eb282b164412cb351d2745b80ed6a/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:37.897236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d163-4a91-422f-8173-14de4d55f485 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.897236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d163-4a91-422f-8173-14de4d55f485 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.897236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36d163-4a91-422f-8173-14de4d55f485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.925670 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-db36d163-4a91-422f-8173-14de4d55f485 None None] MFA Rules not processed for user `429eb282b164412cb351d2745b80ed6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:37.931549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-db36d163-4a91-422f-8173-14de4d55f485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:38.000356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 908/1831] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:38.015234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:38.017005 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:38.083115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1df36-3fb4-4051-8dd1-b4eef55b80d7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:38.087541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131073df-509d-41cd-bb2c-d94e5a7b1b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:38.088218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131073df-509d-41cd-bb2c-d94e5a7b1b32 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:38.088504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131073df-509d-41cd-bb2c-d94e5a7b1b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:38.092184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131073df-509d-41cd-bb2c-d94e5a7b1b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:38.097882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131073df-509d-41cd-bb2c-d94e5a7b1b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:38.104789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131073df-509d-41cd-bb2c-d94e5a7b1b32 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:38.110753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 924/1832] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:38.131595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36d163-4a91-422f-8173-14de4d55f485 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:38.212718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36d163-4a91-422f-8173-14de4d55f485 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:38.218372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:38.219253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:38.219553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:38.219870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] PATH_INFO: `/v3/users/429eb282b164412cb351d2745b80ed6a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:38.221116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429eb282b164412cb351d2745b80ed6a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:38.223112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:38.539353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429eb282b164412cb351d2745b80ed6a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:38.541455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429eb282b164412cb351d2745b80ed6a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:38.652441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429eb282b164412cb351d2745b80ed6a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:38.668220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429eb282b164412cb351d2745b80ed6a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:38.669049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429eb282b164412cb351d2745b80ed6a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:38.690035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 909/1833] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:38 2022] DELETE /identity/v3/users/429eb282b164412cb351d2745b80ed6a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:38.695595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:38.695595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:38.695595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:38.716935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:38.718367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:38.832050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 925/1834] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:38.869812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:38.871320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:38.952008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07108683-b2e5-4727-9ba4-321a4e38dd80 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:38.970403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe95ba-d7d7-4009-a3d5-ab53dd0e18a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:38.971007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe95ba-d7d7-4009-a3d5-ab53dd0e18a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:38.971297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe95ba-d7d7-4009-a3d5-ab53dd0e18a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:38.971576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe95ba-d7d7-4009-a3d5-ab53dd0e18a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:38.988170 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe95ba-d7d7-4009-a3d5-ab53dd0e18a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:38.989812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe95ba-d7d7-4009-a3d5-ab53dd0e18a0 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:39.002180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 910/1835] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:39.516937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:39.518746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:39.537119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86338d45-a6e6-493b-884d-a8b77442d22a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:39.551334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:39.552282 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:39.552644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:39.552995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] PATH_INFO: `/v3/projects/39ab59731df349d7920ca90d576df86a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:39.558088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ab59731df349d7920ca90d576df86a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:39.560207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:39.724344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ab59731df349d7920ca90d576df86a', 'request_id': 'req-8f986566-fc70-4f1b-97a2-a88fd808a03d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:39.838046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ab59731df349d7920ca90d576df86a', 'request_id': 'req-8f986566-fc70-4f1b-97a2-a88fd808a03d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:39.840494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ab59731df349d7920ca90d576df86a', 'request_id': 'req-8f986566-fc70-4f1b-97a2-a88fd808a03d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:39.885385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] The token cache is being invalidate because project 39ab59731df349d7920ca90d576df86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:39.885385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:39.889574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8f986566-fc70-4f1b-97a2-a88fd808a03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:39.901687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 926/1836] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:39 2022] DELETE /identity/v3/projects/39ab59731df349d7920ca90d576df86a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:39.905429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4433a3-5d2e-4b81-812c-cad306b84caf None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:39.908381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4433a3-5d2e-4b81-812c-cad306b84caf None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:39.908381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4433a3-5d2e-4b81-812c-cad306b84caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:39.980012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-0f4433a3-5d2e-4b81-812c-cad306b84caf None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:39.981173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0f4433a3-5d2e-4b81-812c-cad306b84caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:40.087914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12760f-8983-44bd-8716-33229384b0ec None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:40.088550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12760f-8983-44bd-8716-33229384b0ec None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:40.090134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12760f-8983-44bd-8716-33229384b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:40.097863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 911/1837] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:40.125948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1b12760f-8983-44bd-8716-33229384b0ec None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:40.127189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1b12760f-8983-44bd-8716-33229384b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:40.147441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 927/1838] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:40.151854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4433a3-5d2e-4b81-812c-cad306b84caf None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:40.182433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4433a3-5d2e-4b81-812c-cad306b84caf None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:40.194174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:40.195575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:40.195871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:40.196155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:40.197448 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:40.197762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:40.200761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:40.229660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 912/1839] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:40.231012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12760f-8983-44bd-8716-33229384b0ec None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:40.244046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12760f-8983-44bd-8716-33229384b0ec None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:40.255302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:40.256332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:40.256623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:40.257491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:40.258234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:40.260162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:40.535695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 928/1840] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:40 2022] POST /identity/v3/projects => generated 377 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:40.541611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:40.555529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3527-143c-432a-87c8-e7c124e9b2d6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:40.638509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:40.642221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:40.644220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:40.644699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:40.647524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:40.657034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:40.776981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 913/1841] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:40 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:40.781217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:40.789862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:40.794090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:40.807480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e77e4-826f-4441-bbc6-aaa58fcc17da admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:40.849085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9941d-b3d3-42e8-8daf-772b7b3cb624 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:40.850018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:40.851239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:40.851522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:40.851797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:40.853855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:40.855516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:40.873213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:40.878400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:40.878781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:40.879068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] PATH_INFO: `/v3/users/796b66fe4d8b4b52b4078a2bca9ba688` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:40.890366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796b66fe4d8b4b52b4078a2bca9ba688)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:40.897373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:40.900868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 929/1842] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:40.902413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:40.921737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3940e1-3584-4fc2-886b-5bc8d3607694 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:40.933172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:40.934034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:40.934316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:40.936129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:40.937213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:40.943289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:40.972248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 930/1843] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:40.975805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:40.995599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b008fd0-53d8-43e4-8b90-2b4305f7a949 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:41.022170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dbea0-cc33-4b13-b9ac-123c1c6854be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:41.023320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dbea0-cc33-4b13-b9ac-123c1c6854be admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:41.023612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dbea0-cc33-4b13-b9ac-123c1c6854be admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:41.023885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dbea0-cc33-4b13-b9ac-123c1c6854be admin admin] PATH_INFO: `/v3/projects/1367e832dc5b47bd8b511bb71c697198/users/6f4edfda63dd42e2887d128131d3c49a/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:41.068032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dbea0-cc33-4b13-b9ac-123c1c6854be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1367e832dc5b47bd8b511bb71c697198, user_id=6f4edfda63dd42e2887d128131d3c49a, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:41.071681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dbea0-cc33-4b13-b9ac-123c1c6854be admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:41.170054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796b66fe4d8b4b52b4078a2bca9ba688'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:41.176794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796b66fe4d8b4b52b4078a2bca9ba688'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:41.244787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 931/1844] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:40 2022] PUT /identity/v3/projects/1367e832dc5b47bd8b511bb71c697198/users/6f4edfda63dd42e2887d128131d3c49a/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:41.256380 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:41.256659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:41.257122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:41.299213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] MFA Rules not processed for user `6f4edfda63dd42e2887d128131d3c49a`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:41.300734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:41.322141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796b66fe4d8b4b52b4078a2bca9ba688'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:41.336737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796b66fe4d8b4b52b4078a2bca9ba688'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:41.338319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aec1dd4b-7ed1-4346-a390-a60c5f726e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796b66fe4d8b4b52b4078a2bca9ba688'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:41.354736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 914/1845] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:40 2022] DELETE /identity/v3/users/796b66fe4d8b4b52b4078a2bca9ba688 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:41.364268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:41.364698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:41.365077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:41.384251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 932/1846] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:41.391609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:41.393040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:41.397750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:41.399735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:41.478476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb4cd-ff5a-4ab5-9692-4285c3fb0d44 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:41.487970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 915/1847] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:41.497723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:41.503772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:41.552273 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:41.553247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:41.553844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:41.554485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:41.589239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c27f-cb1e-46bb-a152-a3360d823984 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:41.594580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:41.595514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:41.595888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:41.596856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:41.611536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:41.613508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:41.626194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 916/1848] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:41.627061 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:41.637288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:41.639535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:41.641504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:41.653560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 933/1849] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:41.701470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388fc5-224f-482a-abb1-bb1713eed984 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:41.705773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:41.706624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:41.707052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:41.707480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:41.709486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:41.790192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:41.791666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:41.801612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 917/1850] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:42.109008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:42.110685 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:42.125853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18acbe0-3cc4-4016-a371-80cc221d7151 service glance] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:42.130534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:42.131417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.131862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.132158 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] PATH_INFO: `/v3/projects/5a911b3509574a7bb421f9248ecddbc6` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.133417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a911b3509574a7bb421f9248ecddbc6)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:42.135517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:42.295829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a911b3509574a7bb421f9248ecddbc6', 'request_id': 'req-d55e86c7-ff51-4970-90f5-4d195b8827de'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.380917 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a911b3509574a7bb421f9248ecddbc6', 'request_id': 'req-d55e86c7-ff51-4970-90f5-4d195b8827de'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.386991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a911b3509574a7bb421f9248ecddbc6', 'request_id': 'req-d55e86c7-ff51-4970-90f5-4d195b8827de'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.398696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] The token cache is being invalidate because project 5a911b3509574a7bb421f9248ecddbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:42.398984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.399624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.401246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 934/1851] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:42 2022] DELETE /identity/v3/projects/5a911b3509574a7bb421f9248ecddbc6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:42.405612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:42.416792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a6d2-8dfd-4b93-a5b7-6e0c5e05a78c service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:42.470443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:42.471387 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.471689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.471965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] PATH_INFO: `/v3/users/f59b23dd3434428e8e6cbfb82497d346` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.473197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59b23dd3434428e8e6cbfb82497d346)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:42.475210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:42.655423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59b23dd3434428e8e6cbfb82497d346'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.656253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59b23dd3434428e8e6cbfb82497d346'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.735492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59b23dd3434428e8e6cbfb82497d346'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.750799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59b23dd3434428e8e6cbfb82497d346'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.752441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-db3a4cdc-5cbc-4438-897a-74a09dbea919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59b23dd3434428e8e6cbfb82497d346'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:42.767551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 918/1852] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:42 2022] DELETE /identity/v3/users/f59b23dd3434428e8e6cbfb82497d346 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:43.193831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:43.195409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:43.211396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e86c7-ff51-4970-90f5-4d195b8827de admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:43.278896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:43.279763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:43.280046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:43.280324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] PATH_INFO: `/v3/projects/4476126a7c5c4a3bbaf185fd807b20ef` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:43.281578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4476126a7c5c4a3bbaf185fd807b20ef)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:43.283490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:43.446573 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4476126a7c5c4a3bbaf185fd807b20ef', 'request_id': 'req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:43.552780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4476126a7c5c4a3bbaf185fd807b20ef', 'request_id': 'req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:43.559569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4476126a7c5c4a3bbaf185fd807b20ef', 'request_id': 'req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:43.571225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] The token cache is being invalidate because project 4476126a7c5c4a3bbaf185fd807b20ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:43.571618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:43.572342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ea18f5f4-a5ff-42cd-b0e1-f298b62f6fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:43.577331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 935/1853] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:43 2022] DELETE /identity/v3/projects/4476126a7c5c4a3bbaf185fd807b20ef => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:43.579510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c72d4-2656-43de-abba-d067198681d0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:43.579963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c72d4-2656-43de-abba-d067198681d0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:43.580074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c72d4-2656-43de-abba-d067198681d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:43.607884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-880c72d4-2656-43de-abba-d067198681d0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:43.607884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-880c72d4-2656-43de-abba-d067198681d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:43.677460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 919/1854] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:43.680748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e622578-c06f-40b5-946c-c4bed9276eca None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:43.681088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e622578-c06f-40b5-946c-c4bed9276eca None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:43.681465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e622578-c06f-40b5-946c-c4bed9276eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.066011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-7e622578-c06f-40b5-946c-c4bed9276eca None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:44.066011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7e622578-c06f-40b5-946c-c4bed9276eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:44.066011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 936/1855] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:44.067469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c72d4-2656-43de-abba-d067198681d0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:44.067469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c72d4-2656-43de-abba-d067198681d0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:44.067469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:44.067469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.068102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.068102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.068102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:44.068102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:44.068102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:44.068102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 920/1856] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:44.068887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e622578-c06f-40b5-946c-c4bed9276eca None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:44.078694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e622578-c06f-40b5-946c-c4bed9276eca None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:44.088020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:44.088801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.089008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.089336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.090057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:44.092211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:44.234751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 937/1857] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:44 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:44.293416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:44.303201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246686a-975e-46b8-b695-15fdb54cbc2f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:44.365917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:44.366269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.366550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.366824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.367536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:44.369475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:44.961177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 921/1858] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:44 2022] POST /identity/v3/users => generated 294 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:44.962296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:44.972416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dac032-f26b-44b7-8780-f2aaa3199900 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:44.980418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:44.980418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.980418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.980418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.980752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:44.981978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:44.992505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 938/1859] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:44.996476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.006285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720ec2-1d73-4824-923c-4f91481da8d0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.010804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8efd-28dc-4e34-845f-686355f36d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.011454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8efd-28dc-4e34-845f-686355f36d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.011737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8efd-28dc-4e34-845f-686355f36d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.012017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8efd-28dc-4e34-845f-686355f36d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.012752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee8efd-28dc-4e34-845f-686355f36d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.014378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee8efd-28dc-4e34-845f-686355f36d4e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.024553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 922/1860] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:45.028590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.039070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4626-8e9d-4874-bdf4-74c53638630d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.043844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.044849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.045133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.045443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] PATH_INFO: `/v3/projects/d69b30c4f6c1484d9d52d5c96275594d/users/4e1bd90cc33d4018924352fb68f54b1e/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.064810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69b30c4f6c1484d9d52d5c96275594d, user_id=4e1bd90cc33d4018924352fb68f54b1e, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.068741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.146574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 939/1861] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:45 2022] PUT /identity/v3/projects/d69b30c4f6c1484d9d52d5c96275594d/users/4e1bd90cc33d4018924352fb68f54b1e/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:45.157390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4357ea-89cb-46d4-8b3d-9d4a700dbcbc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.158251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4357ea-89cb-46d4-8b3d-9d4a700dbcbc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.158251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4357ea-89cb-46d4-8b3d-9d4a700dbcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.184278 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-de4357ea-89cb-46d4-8b3d-9d4a700dbcbc None None] MFA Rules not processed for user `4e1bd90cc33d4018924352fb68f54b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:45.185559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-de4357ea-89cb-46d4-8b3d-9d4a700dbcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:45.256648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 923/1862] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:45.261745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.321534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056b37-581c-483e-86b5-37eb954517c9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.327256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.327977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.328260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.328534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.329494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.334849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.462224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 940/1863] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:45 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:45.466138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4357ea-89cb-46d4-8b3d-9d4a700dbcbc None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.476506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4357ea-89cb-46d4-8b3d-9d4a700dbcbc None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.532435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.533022 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.533337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.533613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.534330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.536266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.632644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 924/1864] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:45 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:45.636734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.646934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b9bf6-a39a-40f6-8eba-eaaf21eeb009 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.652051 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.652689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.652974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.653425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.654145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.655756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.666569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 941/1865] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:45.670703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.681831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ca86d-10a5-41c5-852b-c38c52929926 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.686588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.687470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.687794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.688069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] PATH_INFO: `/v3/projects/b21bcbfc6f2f4359b97ad144516b5788/users/f5d06782071f4707b20d67e9ecc745e3/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.703350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21bcbfc6f2f4359b97ad144516b5788, user_id=f5d06782071f4707b20d67e9ecc745e3, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.706405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.811830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 925/1866] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:45 2022] PUT /identity/v3/projects/b21bcbfc6f2f4359b97ad144516b5788/users/f5d06782071f4707b20d67e9ecc745e3/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:45.817678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.829790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c85e4-6f38-4cdd-88ea-ac84d9b7638f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.889397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3975f-c32c-4f9c-badf-25391e2d6989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.890059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3975f-c32c-4f9c-badf-25391e2d6989 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.890338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3975f-c32c-4f9c-badf-25391e2d6989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.890609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3975f-c32c-4f9c-badf-25391e2d6989 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.891365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3975f-c32c-4f9c-badf-25391e2d6989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.892946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3975f-c32c-4f9c-badf-25391e2d6989 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.903247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 942/1867] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:45.907301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:45.917810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f417d-fa36-416a-b223-1658c387d2aa admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:45.922447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:45.923322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.923607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.923885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] PATH_INFO: `/v3/projects/b21bcbfc6f2f4359b97ad144516b5788/users/f5d06782071f4707b20d67e9ecc745e3/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.925911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21bcbfc6f2f4359b97ad144516b5788, user_id=f5d06782071f4707b20d67e9ecc745e3, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:45.928520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:45.938596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 926/1868] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:45 2022] PUT /identity/v3/projects/b21bcbfc6f2f4359b97ad144516b5788/users/f5d06782071f4707b20d67e9ecc745e3/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:45.950885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab88c-28be-4002-91b9-1be4eab89eb4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:45.954526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab88c-28be-4002-91b9-1be4eab89eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:45.954526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab88c-28be-4002-91b9-1be4eab89eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:45.980815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3b0ab88c-28be-4002-91b9-1be4eab89eb4 None None] MFA Rules not processed for user `f5d06782071f4707b20d67e9ecc745e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:45.982062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3b0ab88c-28be-4002-91b9-1be4eab89eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:46.048156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 943/1869] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:46.060871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:46.063249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:46.121495 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475fc73-89b6-4bd8-b907-dfd10af00192 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:46.125250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2cadf-06d0-4b99-8cae-09183831e61f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:46.125920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2cadf-06d0-4b99-8cae-09183831e61f service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:46.126204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2cadf-06d0-4b99-8cae-09183831e61f service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:46.126479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2cadf-06d0-4b99-8cae-09183831e61f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:46.137433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2cadf-06d0-4b99-8cae-09183831e61f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:46.138955 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2cadf-06d0-4b99-8cae-09183831e61f service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:46.149099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 927/1870] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:46.298450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ab88c-28be-4002-91b9-1be4eab89eb4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:46.360430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ab88c-28be-4002-91b9-1be4eab89eb4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:46.365360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:46.366319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:46.366605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:46.366881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] PATH_INFO: `/v3/users/4e1bd90cc33d4018924352fb68f54b1e` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:46.368213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1bd90cc33d4018924352fb68f54b1e)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:46.370245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:46.604903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1bd90cc33d4018924352fb68f54b1e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:46.605576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1bd90cc33d4018924352fb68f54b1e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:46.616628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1bd90cc33d4018924352fb68f54b1e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:46.706854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1bd90cc33d4018924352fb68f54b1e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:46.708118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1bd90cc33d4018924352fb68f54b1e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:46.722788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 944/1871] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:46 2022] DELETE /identity/v3/users/4e1bd90cc33d4018924352fb68f54b1e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:46.729735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:46.730019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:46.730298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:46.748147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:46.750653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:46.806746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 928/1872] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:46.816290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:46.817755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:46.882270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c5c4e-d9b9-4750-a0f8-e62bf8d2fc1d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:46.886117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:46.888297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:46.888297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:46.888297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:46.896160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:46.898186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:46.907485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 945/1873] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:47.318580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:47.320509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:47.332292 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71422272-d9ce-40bd-b617-9702c5fbc836 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:47.337780 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:47.338674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:47.338950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:47.339219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] PATH_INFO: `/v3/users/45cd64bef6d548da981d39981a76f800` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:47.340402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cd64bef6d548da981d39981a76f800)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:47.342407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:47.371335 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:47.372767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:47.392231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a48f4-1cb5-49e5-b449-3cae2db4ee56 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:47.401779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:47.402844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:47.403176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:47.403343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] PATH_INFO: `/v3/projects/d69b30c4f6c1484d9d52d5c96275594d` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:47.404566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69b30c4f6c1484d9d52d5c96275594d)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:47.406827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:47.606889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69b30c4f6c1484d9d52d5c96275594d', 'request_id': 'req-38f72c01-e291-46c1-8e0a-8e993fb36de4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.607029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cd64bef6d548da981d39981a76f800'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.611623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cd64bef6d548da981d39981a76f800'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.729674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69b30c4f6c1484d9d52d5c96275594d', 'request_id': 'req-38f72c01-e291-46c1-8e0a-8e993fb36de4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.735701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69b30c4f6c1484d9d52d5c96275594d', 'request_id': 'req-38f72c01-e291-46c1-8e0a-8e993fb36de4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.747195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] The token cache is being invalidate because project d69b30c4f6c1484d9d52d5c96275594d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:47.756076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.756076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.756076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 946/1874] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:47 2022] DELETE /identity/v3/projects/d69b30c4f6c1484d9d52d5c96275594d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:47.756076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:47.756076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:47.816372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f72c01-e291-46c1-8e0a-8e993fb36de4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:47.821751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:47.822601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:47.822890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:47.823172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] PATH_INFO: `/v3/users/f5d06782071f4707b20d67e9ecc745e3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:47.824381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d06782071f4707b20d67e9ecc745e3)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:47.826348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:47.999437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cd64bef6d548da981d39981a76f800'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.999437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cd64bef6d548da981d39981a76f800'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:47.999437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef7a4302-eb55-4468-b81b-69c2345c3ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cd64bef6d548da981d39981a76f800'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:48.003120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 929/1875] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:47 2022] DELETE /identity/v3/users/45cd64bef6d548da981d39981a76f800 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:48.007935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:48.008221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:48.008498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:48.024941 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:48.026153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:48.081852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 930/1876] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:48.094504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:48.095914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:48.149863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d925a9-948b-47b4-925b-a68e1963524d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:48.153817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:48.154325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:48.154606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:48.154879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:48.164296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:48.165810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:48.174907 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 931/1877] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:48.200594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d06782071f4707b20d67e9ecc745e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:48.201261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d06782071f4707b20d67e9ecc745e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:48.212974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d06782071f4707b20d67e9ecc745e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:48.535617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d06782071f4707b20d67e9ecc745e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:48.536282 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d06782071f4707b20d67e9ecc745e3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:48.548533 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 947/1878] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:47 2022] DELETE /identity/v3/users/f5d06782071f4707b20d67e9ecc745e3 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:48.881199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:48.884238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:48.899217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81933f7-7297-4257-96fc-9558f4e67392 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:48.967058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:48.968133 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:48.969134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:48.969580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] PATH_INFO: `/v3/projects/65e78c3d9472411e9c5b139e42c996d1` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:48.970878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e78c3d9472411e9c5b139e42c996d1)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:48.972779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.033588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.034999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:49.049263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48b10-2553-4d9f-a0cb-07aa15fe4d5e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.067850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.069170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.069642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.069972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] PATH_INFO: `/v3/projects/b21bcbfc6f2f4359b97ad144516b5788` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.071335 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21bcbfc6f2f4359b97ad144516b5788)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.073515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.075497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e78c3d9472411e9c5b139e42c996d1', 'request_id': 'req-afb37221-4a1c-4472-8954-26d15039887c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.152346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e78c3d9472411e9c5b139e42c996d1', 'request_id': 'req-afb37221-4a1c-4472-8954-26d15039887c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.159016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e78c3d9472411e9c5b139e42c996d1', 'request_id': 'req-afb37221-4a1c-4472-8954-26d15039887c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.169415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] The token cache is being invalidate because project 65e78c3d9472411e9c5b139e42c996d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:49.169704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.170342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.171979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 932/1879] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:48 2022] DELETE /identity/v3/projects/65e78c3d9472411e9c5b139e42c996d1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:49.175911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.177243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:49.228620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21bcbfc6f2f4359b97ad144516b5788', 'request_id': 'req-fad853fc-9f58-4b0c-b7af-32e53822e772'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.251274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb37221-4a1c-4472-8954-26d15039887c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.321028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21bcbfc6f2f4359b97ad144516b5788', 'request_id': 'req-fad853fc-9f58-4b0c-b7af-32e53822e772'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.330248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.331329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.331798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.332164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] PATH_INFO: `/v3/users/976f3f055b1d4a4cadbf726a5672b90a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.332926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21bcbfc6f2f4359b97ad144516b5788', 'request_id': 'req-fad853fc-9f58-4b0c-b7af-32e53822e772'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.333543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=976f3f055b1d4a4cadbf726a5672b90a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.335924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.347368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] The token cache is being invalidate because project b21bcbfc6f2f4359b97ad144516b5788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:49.347520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.348119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fad853fc-9f58-4b0c-b7af-32e53822e772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.350021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 948/1880] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:49 2022] DELETE /identity/v3/projects/b21bcbfc6f2f4359b97ad144516b5788 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:49.355862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3531e-14e0-4fc3-bed2-faf54162ef94 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.356444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3531e-14e0-4fc3-bed2-faf54162ef94 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.356633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3531e-14e0-4fc3-bed2-faf54162ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.375128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-45d3531e-14e0-4fc3-bed2-faf54162ef94 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:49.376311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-45d3531e-14e0-4fc3-bed2-faf54162ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:49.385250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 949/1881] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:49.393140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfae45f-aa56-476c-9f4e-5fc570d27b0d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.393465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfae45f-aa56-476c-9f4e-5fc570d27b0d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.393747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfae45f-aa56-476c-9f4e-5fc570d27b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.411716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4cfae45f-aa56-476c-9f4e-5fc570d27b0d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:49.412926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4cfae45f-aa56-476c-9f4e-5fc570d27b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:49.432353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 950/1882] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:49.436720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfae45f-aa56-476c-9f4e-5fc570d27b0d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.447606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfae45f-aa56-476c-9f4e-5fc570d27b0d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.452368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.453031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.453367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.453655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.454400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:49.454710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.456573 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.468763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 951/1883] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:49.473069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.482997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534751-7f68-4c28-bda4-4dcfc2852152 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.487659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.488257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.488535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.488805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.489609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.492060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.531114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976f3f055b1d4a4cadbf726a5672b90a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.531976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976f3f055b1d4a4cadbf726a5672b90a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.567816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 952/1884] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:49 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:49.571826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.633430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490325d-d1a4-4578-a4c6-84fdb759d26e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.638382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.639049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.639328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.639603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.640321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.642453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.645822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976f3f055b1d4a4cadbf726a5672b90a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.657135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976f3f055b1d4a4cadbf726a5672b90a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.658436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976f3f055b1d4a4cadbf726a5672b90a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:49.671197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 933/1885] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:49 2022] DELETE /identity/v3/users/976f3f055b1d4a4cadbf726a5672b90a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:49.756567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 953/1886] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:49 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:49.758115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.759704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:49.824161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ecc60-db1a-41a1-94a9-a2d24c6b24bf admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.828805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.829498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.829779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.838018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.838018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.838018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.845003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 934/1887] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:49.846212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.856851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a0e5e-77b5-4db9-bc94-1f21dac87c63 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.861552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe26c2-78da-4ffd-992e-53c26af33ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.862208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe26c2-78da-4ffd-992e-53c26af33ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.862492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe26c2-78da-4ffd-992e-53c26af33ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.862773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe26c2-78da-4ffd-992e-53c26af33ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.863554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe26c2-78da-4ffd-992e-53c26af33ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.865389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe26c2-78da-4ffd-992e-53c26af33ca5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:49.876605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 954/1888] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:49.880909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:49.890997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58dadf-ba89-476b-9786-2113b039ecc7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:49.895696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6eda3-7041-4fd3-8f62-861fc66a5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:49.896563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6eda3-7041-4fd3-8f62-861fc66a5032 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:49.896844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6eda3-7041-4fd3-8f62-861fc66a5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:49.897148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6eda3-7041-4fd3-8f62-861fc66a5032 admin admin] PATH_INFO: `/v3/projects/9f4c7afba05448fbb5ab16561bf97d3b/users/31c36c3688ba42878c426a55d0820b8a/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:49.928213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6eda3-7041-4fd3-8f62-861fc66a5032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4c7afba05448fbb5ab16561bf97d3b, user_id=31c36c3688ba42878c426a55d0820b8a, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:49.928213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6eda3-7041-4fd3-8f62-861fc66a5032 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:50.040599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 935/1889] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:49 2022] PUT /identity/v3/projects/9f4c7afba05448fbb5ab16561bf97d3b/users/31c36c3688ba42878c426a55d0820b8a/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:19:50.054656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:50.054947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:50.055269 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:50.087109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] MFA Rules not processed for user `31c36c3688ba42878c426a55d0820b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:50.088393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:50.105840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:50.106613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:50.106968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:50.124359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] MFA Rules not processed for user `e3609a9d4fe144b68a62ad4696301244`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:50.125673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:50.151783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 955/1890] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:50.161600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:50.163607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:50.181806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 936/1891] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:50.200024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:50.203758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:50.236186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576605b3-0616-45de-8be8-b23bac4a92dd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:50.241292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:50.242318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:50.242604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:50.242995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:50.252536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:50.254911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:50.275946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 956/1892] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:19:50.299360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d215646-ab71-4aec-a659-5e4a09c2e26d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:50.305188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:50.306180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:50.306578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:50.306861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] PATH_INFO: `/v3/projects/70ab38fc8f184f509239944ac7677bb8` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:50.308084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ab38fc8f184f509239944ac7677bb8)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:50.310039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:50.435398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ab38fc8f184f509239944ac7677bb8', 'request_id': 'req-71f36e68-0a26-4733-b722-49a667087b07'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:50.536841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ab38fc8f184f509239944ac7677bb8', 'request_id': 'req-71f36e68-0a26-4733-b722-49a667087b07'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:50.546111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ab38fc8f184f509239944ac7677bb8', 'request_id': 'req-71f36e68-0a26-4733-b722-49a667087b07'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:50.561467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] The token cache is being invalidate because project 70ab38fc8f184f509239944ac7677bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:50.561913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:50.562889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:50.565196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 937/1893] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:50 2022] DELETE /identity/v3/projects/70ab38fc8f184f509239944ac7677bb8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:50.570640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:50.585635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e9493-2edb-4f4e-bf31-a1f0c8f8e8bc service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:50.643327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:50.644197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:50.644576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:50.644977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] PATH_INFO: `/v3/users/eab7ffe869b0420eaf4ae767243a23ba` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:50.646307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab7ffe869b0420eaf4ae767243a23ba)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:50.652708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:50.925491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab7ffe869b0420eaf4ae767243a23ba'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:50.926167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab7ffe869b0420eaf4ae767243a23ba'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:50.941747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab7ffe869b0420eaf4ae767243a23ba'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.055466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab7ffe869b0420eaf4ae767243a23ba'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.056301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94a647a2-7b5f-4297-81c0-d3fb97bfa7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab7ffe869b0420eaf4ae767243a23ba'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.072323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 957/1894] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:19:50 2022] DELETE /identity/v3/users/eab7ffe869b0420eaf4ae767243a23ba => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:51.481638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:51.483961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:51.501555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f36e68-0a26-4733-b722-49a667087b07 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:51.564295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:51.565172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:51.565607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:51.576270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] PATH_INFO: `/v3/projects/70d8410454cb49ce8faea5dc3f080ed6` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:51.576270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d8410454cb49ce8faea5dc3f080ed6)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:51.576270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:51.661215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d8410454cb49ce8faea5dc3f080ed6', 'request_id': 'req-1fb3aa24-c730-4616-833f-120e8eab1e8f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.734909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d8410454cb49ce8faea5dc3f080ed6', 'request_id': 'req-1fb3aa24-c730-4616-833f-120e8eab1e8f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.741729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d8410454cb49ce8faea5dc3f080ed6', 'request_id': 'req-1fb3aa24-c730-4616-833f-120e8eab1e8f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.752177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] The token cache is being invalidate because project 70d8410454cb49ce8faea5dc3f080ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:19:51.752458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.753075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1fb3aa24-c730-4616-833f-120e8eab1e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:19:51.754630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 938/1895] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:19:51 2022] DELETE /identity/v3/projects/70d8410454cb49ce8faea5dc3f080ed6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:51.761200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5045ce-450a-489b-bf91-d4e83380cf3f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:51.761691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5045ce-450a-489b-bf91-d4e83380cf3f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:51.761866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5045ce-450a-489b-bf91-d4e83380cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:51.781130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5a5045ce-450a-489b-bf91-d4e83380cf3f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:51.782418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5a5045ce-450a-489b-bf91-d4e83380cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:51.841350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 958/1896] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:51.849840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c51fd-d7ec-49dd-b7fe-597f1d927af0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:51.850986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c51fd-d7ec-49dd-b7fe-597f1d927af0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:51.850986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c51fd-d7ec-49dd-b7fe-597f1d927af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:51.870028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a21c51fd-d7ec-49dd-b7fe-597f1d927af0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:51.871242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a21c51fd-d7ec-49dd-b7fe-597f1d927af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:51.879023 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 939/1897] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:51.883095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5045ce-450a-489b-bf91-d4e83380cf3f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:51.892745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5045ce-450a-489b-bf91-d4e83380cf3f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:51.897631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:51.898306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:51.898591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:51.898869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:51.899613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:51.899922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:51.901601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:51.913500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 959/1898] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:51.918247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c51fd-d7ec-49dd-b7fe-597f1d927af0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:51.927299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c51fd-d7ec-49dd-b7fe-597f1d927af0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:51.933186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:51.933861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:51.934178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:51.934455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:51.935158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:51.937053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:52.035359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 940/1899] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:19:51 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:52.038699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:52.048804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3481613-d1a6-45bb-9fb9-f06959cc2bd0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:52.107155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:52.108343 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:52.108635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:52.108844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:52.109746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:52.115356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:52.217136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 960/1900] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:19:52 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:52.218213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:52.229479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6330-fd7a-4415-82ed-532a6b0a6113 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:52.234424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:52.235140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:52.238379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:52.238379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:52.238379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:52.238379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:52.249343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 941/1901] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:52.253219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:52.266485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3e6b-c50c-4726-9dd3-31e2a09f1acf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:52.273910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e7aa0-64bc-44fd-b285-482f8b91b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:52.274520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e7aa0-64bc-44fd-b285-482f8b91b7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:52.274822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e7aa0-64bc-44fd-b285-482f8b91b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:52.275090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e7aa0-64bc-44fd-b285-482f8b91b7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:52.275847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e7aa0-64bc-44fd-b285-482f8b91b7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:52.277474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e7aa0-64bc-44fd-b285-482f8b91b7c1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:52.289767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 961/1902] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:52.293747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:52.303529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07fe2-8286-447c-95bf-f71d249a8106 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:52.308201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:52.309069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:52.309379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:52.309657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] PATH_INFO: `/v3/projects/63e1c5a628b6457286fc7b65e170a64a/users/c32ab89738a34a8fb479ce5202608294/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:52.325156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e1c5a628b6457286fc7b65e170a64a, user_id=c32ab89738a34a8fb479ce5202608294, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:52.327820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:52.415732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 942/1903] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:19:52 2022] PUT /identity/v3/projects/63e1c5a628b6457286fc7b65e170a64a/users/c32ab89738a34a8fb479ce5202608294/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:52.427928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408973b-2c92-44da-80dc-a86751aaa4d8 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:52.428221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408973b-2c92-44da-80dc-a86751aaa4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:52.428564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408973b-2c92-44da-80dc-a86751aaa4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:52.454419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6408973b-2c92-44da-80dc-a86751aaa4d8 None None] MFA Rules not processed for user `c32ab89738a34a8fb479ce5202608294`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:52.455609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6408973b-2c92-44da-80dc-a86751aaa4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:52.526852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 962/1904] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:19:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:52.537785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:52.540111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:52.595241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32721b2-b701-4041-b850-8fa169f59854 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:52.598877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d35e3-0f9f-4de6-a4e1-cb2da753fdd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:52.599505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d35e3-0f9f-4de6-a4e1-cb2da753fdd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:52.599782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d35e3-0f9f-4de6-a4e1-cb2da753fdd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:52.600053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d35e3-0f9f-4de6-a4e1-cb2da753fdd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:52.609550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d35e3-0f9f-4de6-a4e1-cb2da753fdd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:52.611773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d35e3-0f9f-4de6-a4e1-cb2da753fdd8 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:52.621603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 943/1905] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:19:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:00.351911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408973b-2c92-44da-80dc-a86751aaa4d8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:00.414622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408973b-2c92-44da-80dc-a86751aaa4d8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:00.419643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:00.420704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:00.420965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:00.421241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] PATH_INFO: `/v3/users/c32ab89738a34a8fb479ce5202608294` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:00.423106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32ab89738a34a8fb479ce5202608294)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:00.425098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:00.596229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32ab89738a34a8fb479ce5202608294'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:00.597268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32ab89738a34a8fb479ce5202608294'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:00.613585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32ab89738a34a8fb479ce5202608294'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:00.708454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32ab89738a34a8fb479ce5202608294'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:00.709077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32ab89738a34a8fb479ce5202608294'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:00.723092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 963/1906] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:00 2022] DELETE /identity/v3/users/c32ab89738a34a8fb479ce5202608294 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:00.728536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:00.729021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:00.729128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:00.747588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:00.748791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:00.811647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 944/1907] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:20:00.822215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:00.823648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:00.886638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:00.888355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:00.890176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3b7e0-77c0-40de-9295-48b153f4557a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:00.894379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa1b5c-c7d8-4102-b1f0-beb7948bd363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:00.895219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1b5c-c7d8-4102-b1f0-beb7948bd363 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:00.895598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1b5c-c7d8-4102-b1f0-beb7948bd363 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:00.895977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa1b5c-c7d8-4102-b1f0-beb7948bd363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:00.907504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1b5c-c7d8-4102-b1f0-beb7948bd363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:00.909177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa1b5c-c7d8-4102-b1f0-beb7948bd363 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:00.925675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53618642-5a0a-4ba0-960c-6595c0becb48 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:00.925675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:00.925675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:00.925675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:00.926211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] PATH_INFO: `/v3/users/31c36c3688ba42878c426a55d0820b8a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:00.926283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 964/1908] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:00.926353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c36c3688ba42878c426a55d0820b8a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:00.927315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:01.160676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c36c3688ba42878c426a55d0820b8a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.161376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c36c3688ba42878c426a55d0820b8a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.248885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c36c3688ba42878c426a55d0820b8a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.261522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c36c3688ba42878c426a55d0820b8a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.262152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c36c3688ba42878c426a55d0820b8a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.273783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 945/1909] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:00 2022] DELETE /identity/v3/users/31c36c3688ba42878c426a55d0820b8a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:01.278709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.279004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.279283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.298799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:01.300028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:01.360617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:01.362249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:01.365366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 965/1910] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:01.375309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:01.376745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:01.378526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e1a9b-6529-4b15-ac01-8dd7974c17b3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:01.385357 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:01.389325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.389325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.389325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] PATH_INFO: `/v3/projects/63e1c5a628b6457286fc7b65e170a64a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.389325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e1c5a628b6457286fc7b65e170a64a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:01.390901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:01.439642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52914678-c059-4330-90d6-7987e64d8c1d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:01.443235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea92391-6d1b-45b3-9638-4afe5555b570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:01.443879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea92391-6d1b-45b3-9638-4afe5555b570 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.444163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea92391-6d1b-45b3-9638-4afe5555b570 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.444441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea92391-6d1b-45b3-9638-4afe5555b570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.453333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea92391-6d1b-45b3-9638-4afe5555b570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:01.454753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea92391-6d1b-45b3-9638-4afe5555b570 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:01.464521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 966/1911] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:01.512811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e1c5a628b6457286fc7b65e170a64a', 'request_id': 'req-63dcc382-6419-4957-8e7e-fad2fdeda8e3'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.632895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e1c5a628b6457286fc7b65e170a64a', 'request_id': 'req-63dcc382-6419-4957-8e7e-fad2fdeda8e3'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.642407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e1c5a628b6457286fc7b65e170a64a', 'request_id': 'req-63dcc382-6419-4957-8e7e-fad2fdeda8e3'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.659057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] The token cache is being invalidate because project 63e1c5a628b6457286fc7b65e170a64a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:01.659379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.660232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63dcc382-6419-4957-8e7e-fad2fdeda8e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:01.665146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 946/1912] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:01 2022] DELETE /identity/v3/projects/63e1c5a628b6457286fc7b65e170a64a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:01.667148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdef059-65ff-4b5f-a713-80b634a85c0f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.667445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdef059-65ff-4b5f-a713-80b634a85c0f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.667738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdef059-65ff-4b5f-a713-80b634a85c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.689593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ebdef059-65ff-4b5f-a713-80b634a85c0f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:01.690824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ebdef059-65ff-4b5f-a713-80b634a85c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:01.783191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 967/1913] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:01.790626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a149fd-8fb1-47e5-b55f-d7d918b4f53e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.791122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a149fd-8fb1-47e5-b55f-d7d918b4f53e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.791234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a149fd-8fb1-47e5-b55f-d7d918b4f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.814780 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c3a149fd-8fb1-47e5-b55f-d7d918b4f53e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:01.816155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c3a149fd-8fb1-47e5-b55f-d7d918b4f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:01.825791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 947/1914] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:01.829692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdef059-65ff-4b5f-a713-80b634a85c0f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:01.840281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdef059-65ff-4b5f-a713-80b634a85c0f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:01.845538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:01.846207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.846491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.846773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.847513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:20:01.847820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:01.849436 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:01.861792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 968/1915] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:20:01.866328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a149fd-8fb1-47e5-b55f-d7d918b4f53e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:01.877472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a149fd-8fb1-47e5-b55f-d7d918b4f53e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:01.882148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:01.883377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.883659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.883935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.884640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:01.886595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:01.948777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:01.950760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:01.973665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012655e-fec7-4e1d-8ee5-f7b7af7dd32b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:01.979710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:01.980770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:01.981697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:01.982119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] PATH_INFO: `/v3/projects/9f4c7afba05448fbb5ab16561bf97d3b` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:01.983367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4c7afba05448fbb5ab16561bf97d3b)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:01.985460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.022904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 948/1916] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:01 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:02.023909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.088729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d27c1-34bb-4269-bf11-d4bcaf022956 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.093702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.094369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.094650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.094926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.095631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.097573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.119186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4c7afba05448fbb5ab16561bf97d3b', 'request_id': 'req-29100855-2f1d-4399-a21b-6dafba6baca2'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:02.201826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 949/1917] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:02.202892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.212808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c9fd-7cfb-4299-bb7d-3be54fddbbad admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.237520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4c7afba05448fbb5ab16561bf97d3b', 'request_id': 'req-29100855-2f1d-4399-a21b-6dafba6baca2'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:02.252370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4c7afba05448fbb5ab16561bf97d3b', 'request_id': 'req-29100855-2f1d-4399-a21b-6dafba6baca2'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:02.266397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] The token cache is being invalidate because project 9f4c7afba05448fbb5ab16561bf97d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:02.266775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:02.267472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-29100855-2f1d-4399-a21b-6dafba6baca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:02.272510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 969/1918] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:01 2022] DELETE /identity/v3/projects/9f4c7afba05448fbb5ab16561bf97d3b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:02.274763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa100d-55b1-4375-adf9-5f6622b74cc1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.275285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa100d-55b1-4375-adf9-5f6622b74cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.283484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.284832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.286435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.286435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.286435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.287389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa100d-55b1-4375-adf9-5f6622b74cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.288302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.303436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 950/1919] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:02.308859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3efa100d-55b1-4375-adf9-5f6622b74cc1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:02.309010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.310509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3efa100d-55b1-4375-adf9-5f6622b74cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:02.311149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:02.327865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f7cd-a2c6-40f0-904b-939a4b27ed56 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.328585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 970/1920] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:02.330413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c2cc-22ab-4271-b0c7-c31f97d94d1d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.330734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.331178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c2cc-22ab-4271-b0c7-c31f97d94d1d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.331403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.331806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.332077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c2cc-22ab-4271-b0c7-c31f97d94d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.332179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.333088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.334740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.347343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 951/1921] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:02.354001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.355570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4c91c2cc-22ab-4271-b0c7-c31f97d94d1d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:02.358945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4c91c2cc-22ab-4271-b0c7-c31f97d94d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:02.371820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 971/1922] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:02.376979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c2cc-22ab-4271-b0c7-c31f97d94d1d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.379894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0a25c-123c-4664-bcc9-f112f5b87445 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.389758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c2cc-22ab-4271-b0c7-c31f97d94d1d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.391417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcf860-75da-437b-98b9-91af71056f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.392576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcf860-75da-437b-98b9-91af71056f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.392863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcf860-75da-437b-98b9-91af71056f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.393142 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcf860-75da-437b-98b9-91af71056f41 admin admin] PATH_INFO: `/v3/projects/6d48156b61e94b91a6f2ab85ea4d1ba8/users/0268ef80be194504a1d0b5652aabbfb4/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.395510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.396601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.397034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.397486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.398435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:20:02.398892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.400663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.416932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 972/1923] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:20:02.421521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.433245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcf860-75da-437b-98b9-91af71056f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d48156b61e94b91a6f2ab85ea4d1ba8, user_id=0268ef80be194504a1d0b5652aabbfb4, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.436186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcf860-75da-437b-98b9-91af71056f41 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.438658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac2b2a-d473-4513-b9fd-cea676f12caf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.451953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.453366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.453807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.454261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.455684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.458154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.501931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 952/1924] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:02 2022] PUT /identity/v3/projects/6d48156b61e94b91a6f2ab85ea4d1ba8/users/0268ef80be194504a1d0b5652aabbfb4/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:02.513198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c0d0-e978-4b01-9790-c482c95b397f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.513703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c0d0-e978-4b01-9790-c482c95b397f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.514007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c0d0-e978-4b01-9790-c482c95b397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.540302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6ca2c0d0-e978-4b01-9790-c482c95b397f None None] MFA Rules not processed for user `0268ef80be194504a1d0b5652aabbfb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:02.541771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6ca2c0d0-e978-4b01-9790-c482c95b397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:02.568375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 973/1925] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:02.570013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.613221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 953/1926] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:20:02.618040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c0d0-e978-4b01-9790-c482c95b397f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.640214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09389e6d-1f4a-4a45-905f-5656f62460f2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.644992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.645927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.646248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.646526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.647363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.649930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.686625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c0d0-e978-4b01-9790-c482c95b397f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.691311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.691962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.692250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.692525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.693240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.695215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.763500 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 974/1927] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:02.767475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.777228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0434d36-7c1d-472d-86f0-92ccb07e25d3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.781876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.782498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.782784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.783059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.783778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.785492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.794154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 954/1928] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:02.797973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.799988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 975/1929] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:20:02.803857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.814897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3b5ff-76b9-4880-b6e5-73b96bc2937d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.884229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02fe6-8a6d-4e9c-b877-e496ca2e5d38 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.889904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.890575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.890859 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.891136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.891895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.893564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.893904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.894316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.894779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.895004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.895859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.898841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.914643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 976/1930] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:02.915231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:02.925074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721b83-9079-4626-9316-0a742a487163 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:02.931590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67947c2b-3f51-46f4-8f81-7b545170591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:02.932350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67947c2b-3f51-46f4-8f81-7b545170591e admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:02.932940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67947c2b-3f51-46f4-8f81-7b545170591e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:02.932940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67947c2b-3f51-46f4-8f81-7b545170591e admin admin] PATH_INFO: `/v3/projects/da5b705b43924d9cb8b99b23beef7110/users/88f8dc9e198d42a4af9ecc103109f477/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:02.948882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67947c2b-3f51-46f4-8f81-7b545170591e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5b705b43924d9cb8b99b23beef7110, user_id=88f8dc9e198d42a4af9ecc103109f477, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:02.951737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67947c2b-3f51-46f4-8f81-7b545170591e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:02.989839 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 955/1931] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:02 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:02.990911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.001130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcaf95-c3f6-4dc9-a81b-e2d095c381c6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.005932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.007779 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.008107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.008353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.009101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.010731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:03.033964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 956/1932] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:03.035305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.038617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 977/1933] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:02 2022] PUT /identity/v3/projects/da5b705b43924d9cb8b99b23beef7110/users/88f8dc9e198d42a4af9ecc103109f477/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:03.046431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa467ce-7faf-4b70-93e7-d650fbff89dd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.049235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.049741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.050276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.084116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] MFA Rules not processed for user `88f8dc9e198d42a4af9ecc103109f477`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:03.086206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:03.123146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.123820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.124104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.124435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.125180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.126820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:03.141305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 957/1934] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:20:03.142158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.152506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7531f-2298-4ae8-8d98-842decd51c23 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.157568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.158606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.160255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.160255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] PATH_INFO: `/v3/projects/a3e816d98f754022bd60d64e419bc583/users/5ede45e3b1ae43d885410741b6e0a93a/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.160431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 978/1935] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:20:03.169867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.171252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:03.178218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e816d98f754022bd60d64e419bc583, user_id=5ede45e3b1ae43d885410741b6e0a93a, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.181325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:03.229298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa38e6-4a03-4a09-9a6d-4f389047e27b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.232948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2fe4-6d7d-4cc5-ba4f-e35aefcd4524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.233640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2fe4-6d7d-4cc5-ba4f-e35aefcd4524 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.233959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2fe4-6d7d-4cc5-ba4f-e35aefcd4524 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.234194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2fe4-6d7d-4cc5-ba4f-e35aefcd4524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.242651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b2fe4-6d7d-4cc5-ba4f-e35aefcd4524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.244081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b2fe4-6d7d-4cc5-ba4f-e35aefcd4524 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:03.252785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 979/1936] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:20:03.298269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 958/1937] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:03 2022] PUT /identity/v3/projects/a3e816d98f754022bd60d64e419bc583/users/5ede45e3b1ae43d885410741b6e0a93a/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:03.301032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789fee-e4d7-4852-801f-9ddd5e657b0e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.301900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789fee-e4d7-4852-801f-9ddd5e657b0e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.302204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789fee-e4d7-4852-801f-9ddd5e657b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.329940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3a789fee-e4d7-4852-801f-9ddd5e657b0e None None] MFA Rules not processed for user `5ede45e3b1ae43d885410741b6e0a93a`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:03.331205 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3a789fee-e4d7-4852-801f-9ddd5e657b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:03.401258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 980/1938] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:03.405985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.469508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1bdde-bb9b-4324-9325-2d20690ad53f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.474841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.475504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.475788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.476086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.476835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.479203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:03.628431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 959/1939] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:03 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:03.633170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789fee-e4d7-4852-801f-9ddd5e657b0e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.646541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789fee-e4d7-4852-801f-9ddd5e657b0e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.712694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.713395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.713686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.713968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.714703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.716721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:03.874084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 981/1940] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:03 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:03.877875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.887958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99007-efc0-4f60-8f9b-1d50784a5dee admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.894273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.894895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.895237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.895456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.896194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.897830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:03.911813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 960/1941] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:03.913157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:03.924318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fb2a8-1e9e-4d50-814d-5a1bc451df26 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:03.929232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:03.930743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:03.931159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:03.931438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] PATH_INFO: `/v3/projects/92469a36b9074f73931c2fc6e38c2b37/users/677365817e704492bf536f0a2fde9ad8/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:03.947546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92469a36b9074f73931c2fc6e38c2b37, user_id=677365817e704492bf536f0a2fde9ad8, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:03.950257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:04.044270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 982/1942] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:03 2022] PUT /identity/v3/projects/92469a36b9074f73931c2fc6e38c2b37/users/677365817e704492bf536f0a2fde9ad8/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:04.047990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:04.057962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a22a5-d598-466e-8154-d203310f12e8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:04.161844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2d42-30d1-446f-b015-18074934895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:04.170368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2d42-30d1-446f-b015-18074934895a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:04.170772 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2d42-30d1-446f-b015-18074934895a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:04.171220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2d42-30d1-446f-b015-18074934895a admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:04.173016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2d42-30d1-446f-b015-18074934895a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:04.175877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2d42-30d1-446f-b015-18074934895a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:04.194953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 961/1943] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:04.196266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:04.211550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9381e-ca94-4404-9a6a-e4d732f35c98 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:04.216725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:04.217724 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:04.217974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:04.218288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] PATH_INFO: `/v3/projects/92469a36b9074f73931c2fc6e38c2b37/users/677365817e704492bf536f0a2fde9ad8/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:04.220344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92469a36b9074f73931c2fc6e38c2b37, user_id=677365817e704492bf536f0a2fde9ad8, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:04.223372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:04.235805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 983/1944] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:04 2022] PUT /identity/v3/projects/92469a36b9074f73931c2fc6e38c2b37/users/677365817e704492bf536f0a2fde9ad8/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:04.247973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a76494-d7c4-417e-a864-49cde19e8fd3 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:04.248514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a76494-d7c4-417e-a864-49cde19e8fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:04.249052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a76494-d7c4-417e-a864-49cde19e8fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:04.284528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f9a76494-d7c4-417e-a864-49cde19e8fd3 None None] MFA Rules not processed for user `677365817e704492bf536f0a2fde9ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:04.285885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f9a76494-d7c4-417e-a864-49cde19e8fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:04.357321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 962/1945] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:04.366140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:04.368768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:04.442218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a765e9-dcbf-40e1-8de2-b732c805b279 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:04.448487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:04.449671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:04.450278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:04.450578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:04.509092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:04.510743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:04.520684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 984/1946] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:06.468398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a76494-d7c4-417e-a864-49cde19e8fd3 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:06.477925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a76494-d7c4-417e-a864-49cde19e8fd3 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:06.481803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:06.482440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:06.482719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:06.482998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:06.544575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:06.546063 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:06.555657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 963/1947] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:09.835126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:09.844175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dcd42-c681-405d-a262-a77e78cc9219 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:09.848103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61042f0-9c45-4759-a29f-3144dc230c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:09.848761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61042f0-9c45-4759-a29f-3144dc230c24 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:09.849082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61042f0-9c45-4759-a29f-3144dc230c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:09.849400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61042f0-9c45-4759-a29f-3144dc230c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:09.858677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61042f0-9c45-4759-a29f-3144dc230c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:09.860156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61042f0-9c45-4759-a29f-3144dc230c24 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:09.869686 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 985/1948] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:10.282382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:10.284049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:10.367483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a06a-0671-40db-9eee-15ffca54b741 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:10.372654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:10.374186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:10.374495 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:10.374773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] PATH_INFO: `/v3/users/6f4edfda63dd42e2887d128131d3c49a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:10.376001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4edfda63dd42e2887d128131d3c49a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:10.378021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:10.635992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4edfda63dd42e2887d128131d3c49a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:10.636732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4edfda63dd42e2887d128131d3c49a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:10.775129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4edfda63dd42e2887d128131d3c49a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:10.787678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4edfda63dd42e2887d128131d3c49a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:10.788347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4edfda63dd42e2887d128131d3c49a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:10.800468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 964/1949] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:10 2022] DELETE /identity/v3/users/6f4edfda63dd42e2887d128131d3c49a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:10.805013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:10.805337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:10.805624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:10.825158 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:10.826415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:10.883683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 986/1950] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:10.893204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:10.894880 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:10.955034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792b996-d588-4422-965f-d5d28877679f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:10.959108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ac341-f7d1-42d2-935c-d575fc8d63ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:10.959831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ac341-f7d1-42d2-935c-d575fc8d63ec service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:10.960127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ac341-f7d1-42d2-935c-d575fc8d63ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:10.960918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ac341-f7d1-42d2-935c-d575fc8d63ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:10.970565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ac341-f7d1-42d2-935c-d575fc8d63ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:10.972034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ac341-f7d1-42d2-935c-d575fc8d63ec service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:10.982791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 965/1951] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:20:11.218042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:11.219994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:11.241511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efbc2a-70cc-4714-9dad-3346e9604dfc None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:11.258635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:11.259750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:11.260211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:11.260719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] PATH_INFO: `/v3/users/c4e830b3807c421e9039bb78a42c393d` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:11.262159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e830b3807c421e9039bb78a42c393d)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:11.264493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:11.369675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:11.370627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:11.370909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:11.392574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] MFA Rules not processed for user `e3609a9d4fe144b68a62ad4696301244`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:11.392574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:11.447147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 966/1952] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:11.476952 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:11.479667 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:11.498005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a754529-a3c8-4c1d-a89a-d1077ebfadc9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:11.510325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:11.511223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:11.511507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:11.511933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] PATH_INFO: `/v3/projects/1367e832dc5b47bd8b511bb71c697198` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:11.513243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1367e832dc5b47bd8b511bb71c697198)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:11.515186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:11.605483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e830b3807c421e9039bb78a42c393d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.606177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e830b3807c421e9039bb78a42c393d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.618181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e830b3807c421e9039bb78a42c393d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.769194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1367e832dc5b47bd8b511bb71c697198', 'request_id': 'req-acc524a0-8056-4e94-b56b-aa8be098ff43'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.797689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e830b3807c421e9039bb78a42c393d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.803238 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ba236825-9c6a-4c7c-aaf4-be7795e3ddf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e830b3807c421e9039bb78a42c393d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.810986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 987/1953] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:11 2022] DELETE /identity/v3/users/c4e830b3807c421e9039bb78a42c393d => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:11.894990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1367e832dc5b47bd8b511bb71c697198', 'request_id': 'req-acc524a0-8056-4e94-b56b-aa8be098ff43'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.903306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1367e832dc5b47bd8b511bb71c697198', 'request_id': 'req-acc524a0-8056-4e94-b56b-aa8be098ff43'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.915906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] The token cache is being invalidate because project 1367e832dc5b47bd8b511bb71c697198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:11.916267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.916983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-acc524a0-8056-4e94-b56b-aa8be098ff43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:11.918602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 967/1954] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:11 2022] DELETE /identity/v3/projects/1367e832dc5b47bd8b511bb71c697198 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:11.923519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15729-b29b-48f9-97f5-75b35cd236c3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:11.923993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15729-b29b-48f9-97f5-75b35cd236c3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:11.924081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d15729-b29b-48f9-97f5-75b35cd236c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:11.942738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f7d15729-b29b-48f9-97f5-75b35cd236c3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:11.944227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f7d15729-b29b-48f9-97f5-75b35cd236c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.017597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 988/1955] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:12.026085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.026376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.026660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.045029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:12.046712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.054887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 968/1956] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:12.058854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d15729-b29b-48f9-97f5-75b35cd236c3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.080067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.083600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.085060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d15729-b29b-48f9-97f5-75b35cd236c3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.092908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.093618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.093906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.094234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.095219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:20:12.095537 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.097152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.114399 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 989/1957] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:20:12.115298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.119992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2886a-4b44-4f4f-ac12-f2d0fefe27ff None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.125860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecac6e9-4cb5-4e57-874f-a90a80d17ae2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.126598 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.127710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.128140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.128415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] PATH_INFO: `/v3/projects/f11a00f62cf540c79ea14b02953dfd19` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.130866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11a00f62cf540c79ea14b02953dfd19)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.133354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.142613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.143383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.143675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.143955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.144887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.146945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.272544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11a00f62cf540c79ea14b02953dfd19', 'request_id': 'req-bbd34f4d-788d-4bea-9178-3396086e6fdd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:12.307431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 990/1958] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:12.311593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.375264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d19bc-412c-4468-9a6f-1c4f18379436 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.383872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.384691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.385093 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.385479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.386355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.389141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.392189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11a00f62cf540c79ea14b02953dfd19', 'request_id': 'req-bbd34f4d-788d-4bea-9178-3396086e6fdd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:12.401935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11a00f62cf540c79ea14b02953dfd19', 'request_id': 'req-bbd34f4d-788d-4bea-9178-3396086e6fdd'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:12.415397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] The token cache is being invalidate because project f11a00f62cf540c79ea14b02953dfd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:12.415698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:12.416833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bbd34f4d-788d-4bea-9178-3396086e6fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:12.418688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 969/1959] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:12 2022] DELETE /identity/v3/projects/f11a00f62cf540c79ea14b02953dfd19 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:12.423314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97e4e-fadc-409f-a3ec-4e66e85efc57 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.423607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97e4e-fadc-409f-a3ec-4e66e85efc57 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.424056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97e4e-fadc-409f-a3ec-4e66e85efc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.442738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-efc97e4e-fadc-409f-a3ec-4e66e85efc57 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:12.443963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-efc97e4e-fadc-409f-a3ec-4e66e85efc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.452822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 970/1960] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:20:12.461376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676141a-9cab-4d79-a72d-ef854b0fdb21 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.461716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676141a-9cab-4d79-a72d-ef854b0fdb21 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.462001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676141a-9cab-4d79-a72d-ef854b0fdb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.480745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1676141a-9cab-4d79-a72d-ef854b0fdb21 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:12.481984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1676141a-9cab-4d79-a72d-ef854b0fdb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.494286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 971/1961] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:20:12.497262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 991/1962] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:12.503340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676141a-9cab-4d79-a72d-ef854b0fdb21 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.503484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.505180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.514778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676141a-9cab-4d79-a72d-ef854b0fdb21 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.519645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.520299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.520584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.520863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.521722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:20:12.522391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.524074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.526379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bdebd-9731-4e42-9d9c-5a6aedf69ee9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.531568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.532748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.533036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.533347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.534770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.536581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.541167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 972/1963] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:20:12.541727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.550074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 992/1964] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:20:12.551247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.552095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00681ac-b73b-4850-b7cb-f4516ad8cddb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.558227 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.558369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.558674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.559026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.559802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.561560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c70ac6-be16-4a56-86e3-3a7ec59b50a3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.562240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.567244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.567903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.568189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.568464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.569200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.571398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.584197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 993/1965] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:12.590340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.599845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea2e6f-9516-4e0c-97e0-4c266e5abab9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.604810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03020677-a709-43a9-8a6d-33927b75d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.605696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020677-a709-43a9-8a6d-33927b75d975 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.605976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020677-a709-43a9-8a6d-33927b75d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.606249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03020677-a709-43a9-8a6d-33927b75d975 admin admin] PATH_INFO: `/v3/projects/627c603fa1e44b699ab1c613764bca8a/users/1968791be3794f908314f94bd1b2349f/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.623300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03020677-a709-43a9-8a6d-33927b75d975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627c603fa1e44b699ab1c613764bca8a, user_id=1968791be3794f908314f94bd1b2349f, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.626199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03020677-a709-43a9-8a6d-33927b75d975 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.673074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 973/1966] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:12.677048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.717678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 994/1967] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:12 2022] PUT /identity/v3/projects/627c603fa1e44b699ab1c613764bca8a/users/1968791be3794f908314f94bd1b2349f/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:12.731082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.731082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.731082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.737076 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d069177-f0a1-4d5e-acc6-29c5f5847bf8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.760549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] MFA Rules not processed for user `1968791be3794f908314f94bd1b2349f`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:12.762243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.798595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.799257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.799535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.799928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.800654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.802610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.825450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 995/1968] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:12.837359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.838670 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:12.892784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d868679-7912-4f73-ad1f-56982aa61efd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.898348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 974/1969] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:12 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:12.898488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.898488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.898488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.898488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.899550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.907008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.908568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.908804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f68bd-3ed4-455e-aa93-4fe199e98c10 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.913432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.914066 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.914350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.914623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.915345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.917043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.917480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 996/1970] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:20:12.930078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 975/1971] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:20:12.931032 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.942128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d222930-f018-4a55-ac69-6a3acc4a2d61 service glance] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.948009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e81bd-6048-4e14-8077-e0e9f331e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.948775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e81bd-6048-4e14-8077-e0e9f331e944 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.949061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e81bd-6048-4e14-8077-e0e9f331e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.949413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e81bd-6048-4e14-8077-e0e9f331e944 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:12.950802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e81bd-6048-4e14-8077-e0e9f331e944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:12.955059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e81bd-6048-4e14-8077-e0e9f331e944 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:12.966676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 997/1972] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:12.970862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:12.987663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f54ef0-9939-438c-bb0e-1b2dfaf5bd42 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:12.992775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:12.993682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:12.993965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:12.994241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] PATH_INFO: `/v3/projects/6cf005ac328a448d859515920b304f57/users/0a2578efc5fe481f8236bdd5dc571080/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:13.010618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf005ac328a448d859515920b304f57, user_id=0a2578efc5fe481f8236bdd5dc571080, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:13.013303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:13.107118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 976/1973] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:12 2022] PUT /identity/v3/projects/6cf005ac328a448d859515920b304f57/users/0a2578efc5fe481f8236bdd5dc571080/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:13.117816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a4abd-714e-428c-95f8-0d0015780313 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:13.118099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a4abd-714e-428c-95f8-0d0015780313 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:13.118413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a4abd-714e-428c-95f8-0d0015780313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:13.145558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b17a4abd-714e-428c-95f8-0d0015780313 None None] MFA Rules not processed for user `0a2578efc5fe481f8236bdd5dc571080`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:13.146697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b17a4abd-714e-428c-95f8-0d0015780313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:13.214224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 998/1974] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:13.218334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:13.287694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecf53-3a43-4c8d-9101-32617c4149ae admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:13.292770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:13.293451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:13.293735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:13.294011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:13.294710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:13.296725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:13.513673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 977/1975] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:13 2022] POST /identity/v3/projects => generated 373 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:20:13.517753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a4abd-714e-428c-95f8-0d0015780313 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:13.528929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a4abd-714e-428c-95f8-0d0015780313 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:13.589725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:13.590537 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:13.590852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:13.591111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:13.591831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:13.594080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:13.737431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 999/1976] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:13 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:13.741709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:13.753696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e5670-4471-425b-856c-abb1f24f78a5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:13.758947 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:13.759672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:13.759952 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:13.760228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:13.764734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:13.764734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:13.772629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 978/1977] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:13.777379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:13.787451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db47e-74e7-48e8-abed-8a777e344132 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:13.792111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:13.799182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:13.799182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:13.799182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] PATH_INFO: `/v3/projects/375ed27971db4cb5bcb3ca9260a2b0f7/users/5ac951cd18ba4686832b702bb8e34b30/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:13.807919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375ed27971db4cb5bcb3ca9260a2b0f7, user_id=5ac951cd18ba4686832b702bb8e34b30, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:13.810675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:13.894385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1000/1978] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:13 2022] PUT /identity/v3/projects/375ed27971db4cb5bcb3ca9260a2b0f7/users/5ac951cd18ba4686832b702bb8e34b30/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:13.898542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:13.908576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d658b0-e4d9-43a3-800d-8be691680265 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:13.975918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926df84-4cfc-46f3-8aee-92854928645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:13.976645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926df84-4cfc-46f3-8aee-92854928645a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:13.976928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926df84-4cfc-46f3-8aee-92854928645a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:13.977269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926df84-4cfc-46f3-8aee-92854928645a admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:13.977972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926df84-4cfc-46f3-8aee-92854928645a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:13.979825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926df84-4cfc-46f3-8aee-92854928645a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:13.989776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 979/1979] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:13.994359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:14.005256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f35d00-b9a0-48e6-ae8a-d5528b11e683 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:14.010024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:14.010915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:14.011190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:14.011458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] PATH_INFO: `/v3/projects/375ed27971db4cb5bcb3ca9260a2b0f7/users/5ac951cd18ba4686832b702bb8e34b30/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:14.013623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375ed27971db4cb5bcb3ca9260a2b0f7, user_id=5ac951cd18ba4686832b702bb8e34b30, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:14.016320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:14.027122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1001/1980] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:13 2022] PUT /identity/v3/projects/375ed27971db4cb5bcb3ca9260a2b0f7/users/5ac951cd18ba4686832b702bb8e34b30/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:14.039035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846be7a2-20fd-4b04-96bc-aada4ce0ef16 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:14.039353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846be7a2-20fd-4b04-96bc-aada4ce0ef16 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:14.039637 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846be7a2-20fd-4b04-96bc-aada4ce0ef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:14.065850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-846be7a2-20fd-4b04-96bc-aada4ce0ef16 None None] MFA Rules not processed for user `5ac951cd18ba4686832b702bb8e34b30`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:14.067072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-846be7a2-20fd-4b04-96bc-aada4ce0ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:14.139636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 980/1981] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:14.151449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:14.153387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:14.209264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5af38-f8fc-45b2-a82d-aab188082463 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:14.213394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:14.214074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:14.214931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:14.214931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:14.224130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:14.225624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:14.236431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1002/1982] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:14.715362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846be7a2-20fd-4b04-96bc-aada4ce0ef16 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:14.726444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846be7a2-20fd-4b04-96bc-aada4ce0ef16 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:14.734462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa277083-c6c3-47b4-a631-d68625b00773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:14.735189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa277083-c6c3-47b4-a631-d68625b00773 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:14.735551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa277083-c6c3-47b4-a631-d68625b00773 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:14.735895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa277083-c6c3-47b4-a631-d68625b00773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:14.799113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa277083-c6c3-47b4-a631-d68625b00773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:14.800720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa277083-c6c3-47b4-a631-d68625b00773 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:14.811400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 981/1983] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:19.784547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:19.786248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:19.862480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd9346-16f7-4c83-80e1-d446e1042171 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:19.868553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:19.869560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:19.869920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:19.870315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] PATH_INFO: `/v3/users/0268ef80be194504a1d0b5652aabbfb4` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:19.871791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0268ef80be194504a1d0b5652aabbfb4)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:19.874052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:20.138558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0268ef80be194504a1d0b5652aabbfb4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:20.140134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0268ef80be194504a1d0b5652aabbfb4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:20.153438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0268ef80be194504a1d0b5652aabbfb4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:20.271378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0268ef80be194504a1d0b5652aabbfb4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:20.272000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0268ef80be194504a1d0b5652aabbfb4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:20.296118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1003/1984] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:19 2022] DELETE /identity/v3/users/0268ef80be194504a1d0b5652aabbfb4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:20.297863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:20.298342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:20.298575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:20.317606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:20.322281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:20.377124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 982/1985] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:20:20.386817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:20.388204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:20.444274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ee4e-14c9-47e7-9602-aa0db1bf5667 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:20.448229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:20.448869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:20.449149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:20.449453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:20.458710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:20.460176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:20.469741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1004/1986] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:20.947430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:20.953969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:20.961225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a934f0-6047-4c17-8700-f01348a3d4bb None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:20.966019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:20.967035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:20.967322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:20.967600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] PATH_INFO: `/v3/projects/6d48156b61e94b91a6f2ab85ea4d1ba8` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:20.968938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d48156b61e94b91a6f2ab85ea4d1ba8)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:20.970998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:21.071610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d48156b61e94b91a6f2ab85ea4d1ba8', 'request_id': 'req-bc21f462-8906-4de1-9071-17266b9ac5b0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.134322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d48156b61e94b91a6f2ab85ea4d1ba8', 'request_id': 'req-bc21f462-8906-4de1-9071-17266b9ac5b0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.141136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d48156b61e94b91a6f2ab85ea4d1ba8', 'request_id': 'req-bc21f462-8906-4de1-9071-17266b9ac5b0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.151766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] The token cache is being invalidate because project 6d48156b61e94b91a6f2ab85ea4d1ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:21.152057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.152698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.154248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 983/1987] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:20 2022] DELETE /identity/v3/projects/6d48156b61e94b91a6f2ab85ea4d1ba8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:21.158184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:21.168421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653938-41c4-4542-a5ef-e401403b00d8 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:21.227587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:21.228729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:21.228996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:21.229360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] PATH_INFO: `/v3/users/5ede45e3b1ae43d885410741b6e0a93a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:21.230645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ede45e3b1ae43d885410741b6e0a93a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:21.232607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:21.407411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ede45e3b1ae43d885410741b6e0a93a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.408157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ede45e3b1ae43d885410741b6e0a93a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.423135 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ede45e3b1ae43d885410741b6e0a93a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.505843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ede45e3b1ae43d885410741b6e0a93a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.506559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ede45e3b1ae43d885410741b6e0a93a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:21.519635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1005/1988] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:21 2022] DELETE /identity/v3/users/5ede45e3b1ae43d885410741b6e0a93a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:21.937683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:21.939274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:21.960128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21f462-8906-4de1-9071-17266b9ac5b0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:22.023101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:22.023959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:22.024242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:22.024693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] PATH_INFO: `/v3/projects/a3e816d98f754022bd60d64e419bc583` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:22.026041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e816d98f754022bd60d64e419bc583)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:22.028024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:22.146092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e816d98f754022bd60d64e419bc583', 'request_id': 'req-87edcdb1-f616-4a14-8787-e44341b6e950'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.237143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e816d98f754022bd60d64e419bc583', 'request_id': 'req-87edcdb1-f616-4a14-8787-e44341b6e950'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.244078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e816d98f754022bd60d64e419bc583', 'request_id': 'req-87edcdb1-f616-4a14-8787-e44341b6e950'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.256533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] The token cache is being invalidate because project a3e816d98f754022bd60d64e419bc583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:22.256825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.257522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.259216 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 984/1989] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:21 2022] DELETE /identity/v3/projects/a3e816d98f754022bd60d64e419bc583 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:22.263267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:22.265052 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:22.278481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0a272-5a3e-4619-8ef4-e432fe074527 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:22.339652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:22.340516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:22.340800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:22.341075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] PATH_INFO: `/v3/users/677365817e704492bf536f0a2fde9ad8` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:22.342305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677365817e704492bf536f0a2fde9ad8)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:22.344350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:22.541790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677365817e704492bf536f0a2fde9ad8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.542552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677365817e704492bf536f0a2fde9ad8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.554108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677365817e704492bf536f0a2fde9ad8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.631646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677365817e704492bf536f0a2fde9ad8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.632888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1d5f41d0-3681-4974-ace6-dfdefab48d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677365817e704492bf536f0a2fde9ad8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:22.645612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1006/1990] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:22 2022] DELETE /identity/v3/users/677365817e704492bf536f0a2fde9ad8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:23.085903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:23.087652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:23.102265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edcdb1-f616-4a14-8787-e44341b6e950 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:23.165858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:23.166718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.167001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.167279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] PATH_INFO: `/v3/projects/92469a36b9074f73931c2fc6e38c2b37` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.168577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92469a36b9074f73931c2fc6e38c2b37)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:23.170470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:23.305726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92469a36b9074f73931c2fc6e38c2b37', 'request_id': 'req-2666638b-7019-487d-8152-b3d4272f0066'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:23.403255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92469a36b9074f73931c2fc6e38c2b37', 'request_id': 'req-2666638b-7019-487d-8152-b3d4272f0066'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:23.410063 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92469a36b9074f73931c2fc6e38c2b37', 'request_id': 'req-2666638b-7019-487d-8152-b3d4272f0066'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:23.420200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] The token cache is being invalidate because project 92469a36b9074f73931c2fc6e38c2b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:23.420323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:23.420945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2666638b-7019-487d-8152-b3d4272f0066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:23.422497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 985/1991] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:23 2022] DELETE /identity/v3/projects/92469a36b9074f73931c2fc6e38c2b37 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:23.428283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a886b3-a93d-4b34-9d26-1530b6e4ebe2 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.428864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a886b3-a93d-4b34-9d26-1530b6e4ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.428978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a886b3-a93d-4b34-9d26-1530b6e4ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.448569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-30a886b3-a93d-4b34-9d26-1530b6e4ebe2 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:23.449914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-30a886b3-a93d-4b34-9d26-1530b6e4ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:23.511085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1007/1992] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:23.519920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6e32-f870-4287-a7f5-52471f6907a5 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.520206 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6e32-f870-4287-a7f5-52471f6907a5 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.520484 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6e32-f870-4287-a7f5-52471f6907a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.540514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c71f6e32-f870-4287-a7f5-52471f6907a5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:23.541994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c71f6e32-f870-4287-a7f5-52471f6907a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:23.549980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 986/1993] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:23.554219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a886b3-a93d-4b34-9d26-1530b6e4ebe2 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:23.563783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a886b3-a93d-4b34-9d26-1530b6e4ebe2 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:23.568651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:23.569889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.570177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.570460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.571199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:20:23.571509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:23.573157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:23.585048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1008/1994] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:20:23.589934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6e32-f870-4287-a7f5-52471f6907a5 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:23.598961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6e32-f870-4287-a7f5-52471f6907a5 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:23.604201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:23.604863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.605171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.605473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.606179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:23.608120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:23.689899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 987/1995] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:23 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:23.693961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:23.704454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb147e-625c-4ed9-8c5a-59327f4584e3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:23.759105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:23.759767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.760046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.760321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.761025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:23.763042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:23.900336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1009/1996] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:23 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:23.904367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:23.914884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ee160-e417-4201-a011-c4bdb56f0f57 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:23.919650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:23.920311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.920594 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.920871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.921656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:23.923275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:23.935093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 988/1997] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:23.939231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:23.949909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee01a9-50b0-4111-b31c-f1483af99b05 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:23.954797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef0b9f-9980-4b47-b851-47017dd4380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:23.955396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0b9f-9980-4b47-b851-47017dd4380b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.955681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0b9f-9980-4b47-b851-47017dd4380b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.955960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0b9f-9980-4b47-b851-47017dd4380b admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:23.956727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef0b9f-9980-4b47-b851-47017dd4380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:23.958379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef0b9f-9980-4b47-b851-47017dd4380b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:23.968101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1010/1998] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:23.972123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:23.982862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe5021-82db-4f59-a60e-eb5f09519489 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:23.987439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:23.988335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:23.988614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:23.988889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] PATH_INFO: `/v3/projects/53499edbb1d04c7fb11ccd028d5afe3c/users/895a7ffef0fb4e65a1ee50b4960c07d3/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:24.003220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53499edbb1d04c7fb11ccd028d5afe3c, user_id=895a7ffef0fb4e65a1ee50b4960c07d3, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:24.005888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:24.100404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 989/1999] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:23 2022] PUT /identity/v3/projects/53499edbb1d04c7fb11ccd028d5afe3c/users/895a7ffef0fb4e65a1ee50b4960c07d3/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:24.111359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:24.111730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:24.112035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:24.138208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] MFA Rules not processed for user `895a7ffef0fb4e65a1ee50b4960c07d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:24.139486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:24.200449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1011/2000] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:24.210644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:24.212421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:24.271669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09de0f-a2ed-41ee-a7dc-9b1b65f96c63 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:24.281645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93208445-bf8a-42bc-82f3-d237f99ce66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:24.282348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93208445-bf8a-42bc-82f3-d237f99ce66e service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:24.282719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93208445-bf8a-42bc-82f3-d237f99ce66e service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:24.283007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93208445-bf8a-42bc-82f3-d237f99ce66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:24.296251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93208445-bf8a-42bc-82f3-d237f99ce66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:24.298579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93208445-bf8a-42bc-82f3-d237f99ce66e service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:24.308681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 990/2001] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:30.061059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:30.062551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:30.133832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8d81-7312-4bd7-bac2-293759df4f18 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:30.138446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:30.139454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:30.139636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:30.139876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] PATH_INFO: `/v3/users/88f8dc9e198d42a4af9ecc103109f477` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:30.141270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f8dc9e198d42a4af9ecc103109f477)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:30.143197 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:30.480162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f8dc9e198d42a4af9ecc103109f477'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:30.480927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f8dc9e198d42a4af9ecc103109f477'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:30.492829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f8dc9e198d42a4af9ecc103109f477'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:30.591209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f8dc9e198d42a4af9ecc103109f477'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:30.591817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f8dc9e198d42a4af9ecc103109f477'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:30.605239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1012/2002] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:20:30 2022] DELETE /identity/v3/users/88f8dc9e198d42a4af9ecc103109f477 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:30.609840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:30.610352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:30.610451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:30.629874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:30.631102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:30.695743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 991/2003] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:30.706147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:30.707432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:30.776075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f267159-e6ae-4729-91b3-207dd0640873 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:30.780396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcf864-7b27-45f9-a7ce-e175bceabd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:30.781060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcf864-7b27-45f9-a7ce-e175bceabd28 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:30.781378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcf864-7b27-45f9-a7ce-e175bceabd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:30.781660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcf864-7b27-45f9-a7ce-e175bceabd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:30.791806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcf864-7b27-45f9-a7ce-e175bceabd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:30.793238 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcf864-7b27-45f9-a7ce-e175bceabd28 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:30.803579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1013/2004] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:31.331382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:31.335803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:31.346995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aab5e-67cf-4a40-9d65-8a09d211efc9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:31.353986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:31.357496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:31.357792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:31.359165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] PATH_INFO: `/v3/projects/da5b705b43924d9cb8b99b23beef7110` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:31.360707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5b705b43924d9cb8b99b23beef7110)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:31.363202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:31.528434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5b705b43924d9cb8b99b23beef7110', 'request_id': 'req-6c837c9d-f5df-44c7-b7f7-346a895f87ee'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:31.631656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5b705b43924d9cb8b99b23beef7110', 'request_id': 'req-6c837c9d-f5df-44c7-b7f7-346a895f87ee'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:31.642776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5b705b43924d9cb8b99b23beef7110', 'request_id': 'req-6c837c9d-f5df-44c7-b7f7-346a895f87ee'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:31.654746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] The token cache is being invalidate because project da5b705b43924d9cb8b99b23beef7110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:20:31.655077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:31.655738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6c837c9d-f5df-44c7-b7f7-346a895f87ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:20:31.657531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 992/2005] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:20:31 2022] DELETE /identity/v3/projects/da5b705b43924d9cb8b99b23beef7110 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:31.662434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3cd3-82c1-448d-acaf-8d2f57e22347 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:31.662908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3cd3-82c1-448d-acaf-8d2f57e22347 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:31.663116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db3cd3-82c1-448d-acaf-8d2f57e22347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:31.681588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f2db3cd3-82c1-448d-acaf-8d2f57e22347 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:31.682999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f2db3cd3-82c1-448d-acaf-8d2f57e22347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:31.751832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1014/2006] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:31.761047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0143ab-5ad0-4e24-ab4f-473eb4f1c1e9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:31.761564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0143ab-5ad0-4e24-ab4f-473eb4f1c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:31.761653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0143ab-5ad0-4e24-ab4f-473eb4f1c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:31.780885 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9d0143ab-5ad0-4e24-ab4f-473eb4f1c1e9 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:31.782112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9d0143ab-5ad0-4e24-ab4f-473eb4f1c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:31.791270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 993/2007] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:31.798164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3cd3-82c1-448d-acaf-8d2f57e22347 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:31.808652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db3cd3-82c1-448d-acaf-8d2f57e22347 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:31.813551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:31.814240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:31.814519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:31.814788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:31.815519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:20:31.815873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:31.817435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:31.830341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1015/2008] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:20:31.834857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0143ab-5ad0-4e24-ab4f-473eb4f1c1e9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:31.844874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0143ab-5ad0-4e24-ab4f-473eb4f1c1e9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:31.851240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:31.851906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:31.852185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:31.852462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:31.853167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:31.855378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:32.005055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 994/2009] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:31 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:32.015364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:32.026816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936051-69a4-4549-83c4-847f68e4942d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:32.090899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:32.091857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:32.092239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:32.092728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:32.093750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:32.096002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:32.225088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1016/2010] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:32 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:32.229802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:32.240392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a045-286b-4fe7-8517-78306dc7fe89 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:32.246233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:32.254343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:32.254343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:32.254343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:32.254343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:32.254343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:32.261426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 995/2011] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:32.265458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:32.278689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7a1a7-7ce5-4862-a8bb-9b30e95d048e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:32.283710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc1bab-644d-40b6-bcf8-477aac730214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:32.284499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc1bab-644d-40b6-bcf8-477aac730214 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:32.285004 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc1bab-644d-40b6-bcf8-477aac730214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:32.285501 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc1bab-644d-40b6-bcf8-477aac730214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:32.286534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc1bab-644d-40b6-bcf8-477aac730214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:32.289066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc1bab-644d-40b6-bcf8-477aac730214 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:32.304710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1017/2012] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:32.305792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:32.317161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc999f0c-96a4-4e62-9841-c2a3933e7e27 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:32.322464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:32.327530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:32.327530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:32.327530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] PATH_INFO: `/v3/projects/5e5dbd3a980c4a1cb1d42b3a8b962124/users/5c6aef15658546e7a2f0592119184000/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:32.338237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5dbd3a980c4a1cb1d42b3a8b962124, user_id=5c6aef15658546e7a2f0592119184000, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:32.340993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:32.449424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 996/2013] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:32 2022] PUT /identity/v3/projects/5e5dbd3a980c4a1cb1d42b3a8b962124/users/5c6aef15658546e7a2f0592119184000/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:20:32.454583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ed54-bd95-4776-bb6a-ba6e82e05459 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:32.454882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ed54-bd95-4776-bb6a-ba6e82e05459 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:32.455163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ed54-bd95-4776-bb6a-ba6e82e05459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:32.472425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9001ed54-bd95-4776-bb6a-ba6e82e05459 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:32.473649 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9001ed54-bd95-4776-bb6a-ba6e82e05459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:32.534253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1018/2014] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:32.544373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:32.546126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:32.601118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23e6db-0d04-43ac-848c-0c575f325503 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:32.605145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:32.605808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:32.606089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:32.606476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:32.615883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:32.617884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:32.627884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 997/2015] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:38.840446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863897a-1b2c-4d8a-8048-615e1fc88650 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:38.840941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863897a-1b2c-4d8a-8048-615e1fc88650 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:38.841088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863897a-1b2c-4d8a-8048-615e1fc88650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:38.874831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6863897a-1b2c-4d8a-8048-615e1fc88650 None None] MFA Rules not processed for user `5c6aef15658546e7a2f0592119184000`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:38.876208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6863897a-1b2c-4d8a-8048-615e1fc88650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:38.947548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1019/2016] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:38.952117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:38.964041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903da65-03e6-40a3-ac8a-69656d872d6f service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:38.981690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:38.982550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:38.982992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:38.983415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:38.984868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:38.987687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:39.075775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 998/2017] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:20:38 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:39.080801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863897a-1b2c-4d8a-8048-615e1fc88650 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:39.095561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863897a-1b2c-4d8a-8048-615e1fc88650 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:39.156908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:39.157693 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:39.158141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:39.158598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:39.159313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:39.161444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:39.244866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1020/2018] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:20:39 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:20:39.248918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:39.262409 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f09ad-8534-4e52-812c-9440d1ecee2e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:39.270217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:39.270983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:39.271467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:39.271596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:39.273083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:39.277588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:39.295261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 999/2019] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:39.298278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:39.311783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ceda6-98cb-482e-b800-d3014c6ec72f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:39.318785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:39.320807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:39.321097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:39.321468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] PATH_INFO: `/v3/projects/9e769c3a1f0c4a99aa9d6542b1fd091c/users/0a9c3da2c6b34ff1bec7cc8afd4f7205/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:39.342695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e769c3a1f0c4a99aa9d6542b1fd091c, user_id=0a9c3da2c6b34ff1bec7cc8afd4f7205, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:39.349318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:39.444975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1021/2020] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:39 2022] PUT /identity/v3/projects/9e769c3a1f0c4a99aa9d6542b1fd091c/users/0a9c3da2c6b34ff1bec7cc8afd4f7205/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:39.448994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:39.459548 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1f367-02f3-45df-ae99-eee6e38b862c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:39.532951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74421ed-5133-466e-82ce-309e217619f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:39.533570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74421ed-5133-466e-82ce-309e217619f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:39.533848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74421ed-5133-466e-82ce-309e217619f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:39.534120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74421ed-5133-466e-82ce-309e217619f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:39.534855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74421ed-5133-466e-82ce-309e217619f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:39.536509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74421ed-5133-466e-82ce-309e217619f1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:39.550540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1000/2021] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:20:39.551784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:39.563322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccea1f-787f-488e-86bc-287431841ce7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:39.568136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:39.569173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:39.569495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:39.569776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] PATH_INFO: `/v3/projects/9e769c3a1f0c4a99aa9d6542b1fd091c/users/0a9c3da2c6b34ff1bec7cc8afd4f7205/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:39.571768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e769c3a1f0c4a99aa9d6542b1fd091c, user_id=0a9c3da2c6b34ff1bec7cc8afd4f7205, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:39.574455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:39.586059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1022/2022] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:20:39 2022] PUT /identity/v3/projects/9e769c3a1f0c4a99aa9d6542b1fd091c/users/0a9c3da2c6b34ff1bec7cc8afd4f7205/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:20:46.069473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514d0fd-bde7-4349-bd18-76c4564a85b8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:46.070068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514d0fd-bde7-4349-bd18-76c4564a85b8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:46.070068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514d0fd-bde7-4349-bd18-76c4564a85b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:46.106928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e514d0fd-bde7-4349-bd18-76c4564a85b8 None None] MFA Rules not processed for user `0a9c3da2c6b34ff1bec7cc8afd4f7205`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:46.108574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e514d0fd-bde7-4349-bd18-76c4564a85b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:46.218248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1001/2023] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:46.234507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:46.244353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:46.358085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c5b50-f898-490d-b7dd-12ecec8be502 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:46.361819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:46.362237 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:46.362526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:46.362807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:46.424859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:46.426080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:46.436397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1023/2024] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:20:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:20:46.696836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5071f73-6926-4f72-acf1-51b72571c1fc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:46.696836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5071f73-6926-4f72-acf1-51b72571c1fc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:46.696836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5071f73-6926-4f72-acf1-51b72571c1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:46.716708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b5071f73-6926-4f72-acf1-51b72571c1fc None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:46.718304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b5071f73-6926-4f72-acf1-51b72571c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:46.804712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1002/2025] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:20:46.854710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:20:46.856581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:46.942160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8791e8-b0e8-43f4-b023-2d1ba5c26c5d service glance] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:20:46.950047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba9d4-b108-4571-8fea-4eb09042922d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:20:46.950858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba9d4-b108-4571-8fea-4eb09042922d service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:46.951324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba9d4-b108-4571-8fea-4eb09042922d service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:46.951835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba9d4-b108-4571-8fea-4eb09042922d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:46.962099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba9d4-b108-4571-8fea-4eb09042922d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:20:46.963806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eba9d4-b108-4571-8fea-4eb09042922d service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:20:46.972546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1024/2026] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:20:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:20:58.933853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf150-fb87-41f1-be2d-b794fb25f5fb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:20:58.934468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf150-fb87-41f1-be2d-b794fb25f5fb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:20:58.934468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecf150-fb87-41f1-be2d-b794fb25f5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:20:58.951249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a8ecf150-fb87-41f1-be2d-b794fb25f5fb None None] MFA Rules not processed for user `5c6aef15658546e7a2f0592119184000`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:20:58.952449 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a8ecf150-fb87-41f1-be2d-b794fb25f5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:20:58.959998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1003/2027] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:20:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:01.970613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621688-893d-46e8-b2a7-fefa81aecef3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:01.970613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621688-893d-46e8-b2a7-fefa81aecef3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:01.970613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621688-893d-46e8-b2a7-fefa81aecef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:01.987785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0a621688-893d-46e8-b2a7-fefa81aecef3 None None] MFA Rules not processed for user `e3609a9d4fe144b68a62ad4696301244`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:01.989168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0a621688-893d-46e8-b2a7-fefa81aecef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:02.109654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1025/2028] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:03.575117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:03.575988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:03.576324 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:03.595388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:03.596829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:03.609576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1004/2029] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:21:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:03.623827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621688-893d-46e8-b2a7-fefa81aecef3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:03.639602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621688-893d-46e8-b2a7-fefa81aecef3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:03.653012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afed8d-3b29-49ac-9a33-d5766a7b619e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:03.654118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afed8d-3b29-49ac-9a33-d5766a7b619e service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:03.655695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afed8d-3b29-49ac-9a33-d5766a7b619e service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:03.656449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afed8d-3b29-49ac-9a33-d5766a7b619e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:03.673378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afed8d-3b29-49ac-9a33-d5766a7b619e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:03.675304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afed8d-3b29-49ac-9a33-d5766a7b619e service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:03.685609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1026/2030] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:21:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:21:04.098686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:04.101678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:04.399264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b1fb-5749-4074-ad18-37ae0a4baca6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:04.411702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:04.413463 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:04.418756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:04.418756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] PATH_INFO: `/v3/users/1968791be3794f908314f94bd1b2349f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:04.418756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1968791be3794f908314f94bd1b2349f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:04.420620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:04.674405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1968791be3794f908314f94bd1b2349f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:04.676007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1968791be3794f908314f94bd1b2349f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:04.757299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1968791be3794f908314f94bd1b2349f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:04.779712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1968791be3794f908314f94bd1b2349f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:04.781091 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1968791be3794f908314f94bd1b2349f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:04.800720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1005/2031] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:04 2022] DELETE /identity/v3/users/1968791be3794f908314f94bd1b2349f => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:04.805896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:04.806384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:04.806476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:04.831913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:04.833884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:04.942161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1027/2032] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:21:04.955420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:04.956847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:05.078750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feaf5c-8471-4c93-b388-ca01fa3e55f8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:05.088215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efca47-0ad5-4861-86aa-23c6e9e3b76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:05.088215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efca47-0ad5-4861-86aa-23c6e9e3b76c service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:05.114629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efca47-0ad5-4861-86aa-23c6e9e3b76c service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:05.115057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efca47-0ad5-4861-86aa-23c6e9e3b76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:05.188117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efca47-0ad5-4861-86aa-23c6e9e3b76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:05.190470 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efca47-0ad5-4861-86aa-23c6e9e3b76c service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:05.233130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1006/2033] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:06.127663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:06.127663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:06.147178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863fb8-4b67-4516-b8cf-c180a531f89c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:06.172325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:06.172325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:06.172325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:06.172325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] PATH_INFO: `/v3/projects/627c603fa1e44b699ab1c613764bca8a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:06.174553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627c603fa1e44b699ab1c613764bca8a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:06.176612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:06.341220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627c603fa1e44b699ab1c613764bca8a', 'request_id': 'req-94105bf9-7ed0-4d46-8357-af3d8ff461e4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:06.448673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627c603fa1e44b699ab1c613764bca8a', 'request_id': 'req-94105bf9-7ed0-4d46-8357-af3d8ff461e4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:06.456180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627c603fa1e44b699ab1c613764bca8a', 'request_id': 'req-94105bf9-7ed0-4d46-8357-af3d8ff461e4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:06.469725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] The token cache is being invalidate because project 627c603fa1e44b699ab1c613764bca8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:21:06.470224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:06.471250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-94105bf9-7ed0-4d46-8357-af3d8ff461e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:06.477936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1028/2034] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:21:06 2022] DELETE /identity/v3/projects/627c603fa1e44b699ab1c613764bca8a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:06.480530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2756c9-561b-45e8-b40d-0de7b209d82f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:06.481446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2756c9-561b-45e8-b40d-0de7b209d82f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:06.482085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2756c9-561b-45e8-b40d-0de7b209d82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:06.508570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-aa2756c9-561b-45e8-b40d-0de7b209d82f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:06.509985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-aa2756c9-561b-45e8-b40d-0de7b209d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:06.597486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1007/2035] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:06.599378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcdc58-2058-41ea-81e1-890ad3b680ee None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:06.600053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcdc58-2058-41ea-81e1-890ad3b680ee None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:06.600488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcdc58-2058-41ea-81e1-890ad3b680ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:06.630487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-dcfcdc58-2058-41ea-81e1-890ad3b680ee None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:06.632757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-dcfcdc58-2058-41ea-81e1-890ad3b680ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:06.642454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1029/2036] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:21:06.646640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2756c9-561b-45e8-b40d-0de7b209d82f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:06.661332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2756c9-561b-45e8-b40d-0de7b209d82f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:06.666331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:06.667117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:06.667403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:06.667700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:06.668580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:21:06.668889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:06.670901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:06.683802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1008/2037] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:21:06.688395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcdc58-2058-41ea-81e1-890ad3b680ee None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:06.712438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcdc58-2058-41ea-81e1-890ad3b680ee None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:06.727092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:06.730020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:06.733646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:06.733971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:06.750010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:06.752025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:06.884687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1030/2038] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:21:06 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:21:06.885984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:06.907623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723ddcc-4c88-45df-a774-61b4d8c955b3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:07.004454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:07.005164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:07.005477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:07.005753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:07.007008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:07.009310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:07.146501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1009/2039] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:21:06 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:21:07.150981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:07.161211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89be5a9-b04a-47be-8d6b-936dd9243330 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:07.166065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:07.166811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:07.167098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:07.167391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:07.168163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:07.169954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:07.182736 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1031/2040] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:07.186963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:07.198512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9263af-98da-4b09-97d2-e19c6c6fecd8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:07.203751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ce8bc-ce20-4dc5-9a60-e276b3ca6753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:07.204732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ce8bc-ce20-4dc5-9a60-e276b3ca6753 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:07.205242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ce8bc-ce20-4dc5-9a60-e276b3ca6753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:07.205551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ce8bc-ce20-4dc5-9a60-e276b3ca6753 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:07.206308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ce8bc-ce20-4dc5-9a60-e276b3ca6753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:07.207932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ce8bc-ce20-4dc5-9a60-e276b3ca6753 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:07.227734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1010/2041] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:07.228983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:07.239921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a7f1-9d2d-412a-8cef-b56d138a53a2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:07.245373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:07.246264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:07.246547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:07.246823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] PATH_INFO: `/v3/projects/7653ea8b212a4ff292921844cb11ab8b/users/2488fb8fa4b44cbda906511bf3f6101b/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:07.262023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7653ea8b212a4ff292921844cb11ab8b, user_id=2488fb8fa4b44cbda906511bf3f6101b, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:07.264696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:07.386194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1032/2042] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:07 2022] PUT /identity/v3/projects/7653ea8b212a4ff292921844cb11ab8b/users/2488fb8fa4b44cbda906511bf3f6101b/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:07.397165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d87b-eb51-4709-ae3e-ed5049c0f383 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:07.397508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d87b-eb51-4709-ae3e-ed5049c0f383 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:07.397791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7d87b-eb51-4709-ae3e-ed5049c0f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:07.427801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b5f7d87b-eb51-4709-ae3e-ed5049c0f383 None None] MFA Rules not processed for user `2488fb8fa4b44cbda906511bf3f6101b`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:07.429631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b5f7d87b-eb51-4709-ae3e-ed5049c0f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:07.548190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1011/2043] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:07.552626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:07.552626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:07.658638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf607a-4d02-461f-a5ff-4b3f6196cc99 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:07.693865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f9b19-aec3-4d39-8c93-17ee2a5e5ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:07.693865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9b19-aec3-4d39-8c93-17ee2a5e5ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:07.693865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9b19-aec3-4d39-8c93-17ee2a5e5ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:07.693865 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9b19-aec3-4d39-8c93-17ee2a5e5ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:07.695140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f9b19-aec3-4d39-8c93-17ee2a5e5ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:07.695140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f9b19-aec3-4d39-8c93-17ee2a5e5ea1 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:07.695140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1033/2044] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:07.716974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7d87b-eb51-4709-ae3e-ed5049c0f383 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:07.799915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7d87b-eb51-4709-ae3e-ed5049c0f383 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:07.806630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:07.807876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:07.808225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:07.808638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] PATH_INFO: `/v3/users/2488fb8fa4b44cbda906511bf3f6101b` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:07.810963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2488fb8fa4b44cbda906511bf3f6101b)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:07.814224 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:08.302095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2488fb8fa4b44cbda906511bf3f6101b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:08.302756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2488fb8fa4b44cbda906511bf3f6101b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:08.384502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2488fb8fa4b44cbda906511bf3f6101b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:08.399577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2488fb8fa4b44cbda906511bf3f6101b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:08.400313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2488fb8fa4b44cbda906511bf3f6101b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:08.414946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1012/2045] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:07 2022] DELETE /identity/v3/users/2488fb8fa4b44cbda906511bf3f6101b => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:08.418814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:08.419290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:08.419391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:08.438572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:08.443210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:08.503508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1034/2046] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:08.514362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:08.515087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:08.579757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4239c-9d53-4db8-a0c8-6e851eb901e4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:08.583690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f5ebc-3aec-463e-853f-3417b92d57a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:08.584400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f5ebc-3aec-463e-853f-3417b92d57a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:08.584684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f5ebc-3aec-463e-853f-3417b92d57a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:08.585007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f5ebc-3aec-463e-853f-3417b92d57a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:08.594659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f5ebc-3aec-463e-853f-3417b92d57a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:08.596095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f5ebc-3aec-463e-853f-3417b92d57a5 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:08.606159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1013/2047] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:09.193517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:09.195953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:09.211940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c770d-42e3-466b-a060-5d3bc3732db4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:09.218008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:09.219095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:09.219439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:09.219758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] PATH_INFO: `/v3/projects/7653ea8b212a4ff292921844cb11ab8b` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:09.221296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7653ea8b212a4ff292921844cb11ab8b)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:09.223611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:09.374541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7653ea8b212a4ff292921844cb11ab8b', 'request_id': 'req-872ffc50-debd-473a-ac92-6432f92c237d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:09.517017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7653ea8b212a4ff292921844cb11ab8b', 'request_id': 'req-872ffc50-debd-473a-ac92-6432f92c237d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:09.523288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7653ea8b212a4ff292921844cb11ab8b', 'request_id': 'req-872ffc50-debd-473a-ac92-6432f92c237d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:09.534327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] The token cache is being invalidate because project 7653ea8b212a4ff292921844cb11ab8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:21:09.534632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:09.535265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-872ffc50-debd-473a-ac92-6432f92c237d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:09.536791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1035/2048] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:21:09 2022] DELETE /identity/v3/projects/7653ea8b212a4ff292921844cb11ab8b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:09.542286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4a41-1511-4630-b2bb-986a6efb0bdd None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:09.542571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4a41-1511-4630-b2bb-986a6efb0bdd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:09.542845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d4a41-1511-4630-b2bb-986a6efb0bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:09.570437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-d03d4a41-1511-4630-b2bb-986a6efb0bdd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:09.571705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d03d4a41-1511-4630-b2bb-986a6efb0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:09.632311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1014/2049] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:21:09.640144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be34a-1eb2-4124-b76d-b25f46f230a0 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:09.640428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be34a-1eb2-4124-b76d-b25f46f230a0 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:09.640726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42be34a-1eb2-4124-b76d-b25f46f230a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:09.661877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c42be34a-1eb2-4124-b76d-b25f46f230a0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:09.663939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c42be34a-1eb2-4124-b76d-b25f46f230a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:09.672639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1036/2050] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:09.676847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d4a41-1511-4630-b2bb-986a6efb0bdd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:09.690228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d4a41-1511-4630-b2bb-986a6efb0bdd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:09.695840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:09.696503 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:09.696789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:09.697069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:09.697843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:21:09.698154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:09.699877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:09.717231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1015/2051] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:21:09.718842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42be34a-1eb2-4124-b76d-b25f46f230a0 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:09.734894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42be34a-1eb2-4124-b76d-b25f46f230a0 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:09.741744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:09.742819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:09.743348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:09.743830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:09.744805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:09.747991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:09.867633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1037/2052] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:21:09 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:21:09.875840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:09.886995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631474b-262a-4a4b-9fc9-9b850874e664 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:09.944114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:09.944782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:09.945068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:09.945393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:09.946118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:09.948017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:10.089333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1016/2053] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:21:09 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:21:10.089976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:10.112936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e6efb-c7ec-46cd-81e1-6c4a9f0b400d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:10.120678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:10.121940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:10.122121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:10.122483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:10.137964 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:10.139628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:10.160515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1038/2054] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:10.165378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:10.175894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc5695-847f-43c1-b19d-eca145dc27af admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:10.182709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05767ac-98cc-4261-b929-f804e1e16ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:10.183653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05767ac-98cc-4261-b929-f804e1e16ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:10.185859 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05767ac-98cc-4261-b929-f804e1e16ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:10.186240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05767ac-98cc-4261-b929-f804e1e16ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:10.188057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05767ac-98cc-4261-b929-f804e1e16ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:10.189914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05767ac-98cc-4261-b929-f804e1e16ff2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:10.205322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1017/2055] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:10.207013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:10.217775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f457d-1b19-43de-ad42-ba9126ad24d6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:10.222302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:10.223193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:10.223472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:10.223744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] PATH_INFO: `/v3/projects/2c9d14816d4e4f7c9fdd17604fe92747/users/5b5c229e1d0c4da7bc08c068d087a6bc/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:10.239484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9d14816d4e4f7c9fdd17604fe92747, user_id=5b5c229e1d0c4da7bc08c068d087a6bc, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:10.242184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:10.409546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1039/2056] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:10 2022] PUT /identity/v3/projects/2c9d14816d4e4f7c9fdd17604fe92747/users/5b5c229e1d0c4da7bc08c068d087a6bc/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:10.415065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99394f97-4d09-4703-a520-ef405e499611 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:10.415384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99394f97-4d09-4703-a520-ef405e499611 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:10.415670 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99394f97-4d09-4703-a520-ef405e499611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:10.449589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-99394f97-4d09-4703-a520-ef405e499611 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:10.449589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-99394f97-4d09-4703-a520-ef405e499611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:10.526255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1018/2057] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:10.533026 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:10.534909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:10.625983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f06bd-ebf5-43a8-a9c4-92d4a843293b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:10.633756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:10.634435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:10.634727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:10.635024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:10.652180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:10.654662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:10.666076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1040/2058] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:12.160916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438067-4b60-4f95-821b-2df49136913f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:12.165196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438067-4b60-4f95-821b-2df49136913f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:12.165901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438067-4b60-4f95-821b-2df49136913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:12.232886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-25438067-4b60-4f95-821b-2df49136913f None None] MFA Rules not processed for user `5b5c229e1d0c4da7bc08c068d087a6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:12.234482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-25438067-4b60-4f95-821b-2df49136913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:12.406520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1019/2059] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:12.548407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:12.549948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:12.668813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc3b17-3929-4672-a63e-f0e3002b7a90 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:12.672663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:12.673350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:12.673640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:12.673913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:12.683030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:12.684450 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:12.693222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1041/2060] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:21:16.764657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd07f53-b5af-41c4-854d-0a0c83ac0d8d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:16.765244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd07f53-b5af-41c4-854d-0a0c83ac0d8d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:16.765244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd07f53-b5af-41c4-854d-0a0c83ac0d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:16.783333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-5fd07f53-b5af-41c4-854d-0a0c83ac0d8d None None] MFA Rules not processed for user `5b5c229e1d0c4da7bc08c068d087a6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:16.784580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5fd07f53-b5af-41c4-854d-0a0c83ac0d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:16.791796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1020/2061] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:21.175737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:21.177193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:21.243076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f32fa6-ec70-48df-baf2-a243050e09d9 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:21.248101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:21.248959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:21.249239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:21.249546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] PATH_INFO: `/v3/users/895a7ffef0fb4e65a1ee50b4960c07d3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:21.250748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895a7ffef0fb4e65a1ee50b4960c07d3)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:21.253021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:21.527128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895a7ffef0fb4e65a1ee50b4960c07d3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:21.527783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895a7ffef0fb4e65a1ee50b4960c07d3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:21.539396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895a7ffef0fb4e65a1ee50b4960c07d3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:21.652366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895a7ffef0fb4e65a1ee50b4960c07d3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:21.653208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895a7ffef0fb4e65a1ee50b4960c07d3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:21.671126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1042/2062] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:21 2022] DELETE /identity/v3/users/895a7ffef0fb4e65a1ee50b4960c07d3 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:21:21.672212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:21.672721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:21.672803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:21.702711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:21.704250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:21.798317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1021/2063] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:21.805440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:21.806900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:21.903250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea8d4f-bf97-4d63-a696-5d24f50d0d64 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:21.905110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:21.905803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:21.906113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:21.906388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:21.916251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:21.917743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:21.926972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1043/2064] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:22.359284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:22.361517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:22.376542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4ada9-8d91-4285-8436-79bd97446b99 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:22.383438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:22.385924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:22.386433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:22.386934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] PATH_INFO: `/v3/users/0a2578efc5fe481f8236bdd5dc571080` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:22.388650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2578efc5fe481f8236bdd5dc571080)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:22.391120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:22.614623 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:22.616890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:22.644097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed08ed-e731-46b5-95fa-1dc7a0aa8e1a service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:22.650227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:22.658644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:22.659816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:22.660318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] PATH_INFO: `/v3/projects/53499edbb1d04c7fb11ccd028d5afe3c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:22.663336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53499edbb1d04c7fb11ccd028d5afe3c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:22.674452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:22.681902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2578efc5fe481f8236bdd5dc571080'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:22.683243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2578efc5fe481f8236bdd5dc571080'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:22.787092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2578efc5fe481f8236bdd5dc571080'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:22.802128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2578efc5fe481f8236bdd5dc571080'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:22.802963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c7d74594-1e93-4cd3-b7a5-8bde42d332d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2578efc5fe481f8236bdd5dc571080'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:22.822083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1022/2065] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:22 2022] DELETE /identity/v3/users/0a2578efc5fe481f8236bdd5dc571080 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:22.825714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:22.826029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:22.833523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:22.857005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:22.859219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:22.868554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53499edbb1d04c7fb11ccd028d5afe3c', 'request_id': 'req-8179523c-48e8-4b86-81b6-7922f0bdd7a4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:22.932126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1023/2066] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:22.951733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:22.953600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:23.014011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53499edbb1d04c7fb11ccd028d5afe3c', 'request_id': 'req-8179523c-48e8-4b86-81b6-7922f0bdd7a4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.020535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53499edbb1d04c7fb11ccd028d5afe3c', 'request_id': 'req-8179523c-48e8-4b86-81b6-7922f0bdd7a4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.027041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147acc25-a7dd-4ec0-9563-0967534e6171 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:23.027184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:23.027756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:23.028035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:23.028312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:23.034772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] The token cache is being invalidate because project 53499edbb1d04c7fb11ccd028d5afe3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:21:23.035192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.036140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.037631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1044/2067] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:21:22 2022] DELETE /identity/v3/projects/53499edbb1d04c7fb11ccd028d5afe3c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:21:23.038195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:23.039630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:23.060264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1024/2068] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:21:23.707372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:23.708866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:23.733677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179523c-48e8-4b86-81b6-7922f0bdd7a4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:23.741807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:23.743142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:23.743615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:23.744173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] PATH_INFO: `/v3/projects/6cf005ac328a448d859515920b304f57` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:23.745897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf005ac328a448d859515920b304f57)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:23.747994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:23.877554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf005ac328a448d859515920b304f57', 'request_id': 'req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.963392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf005ac328a448d859515920b304f57', 'request_id': 'req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.970232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf005ac328a448d859515920b304f57', 'request_id': 'req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.983008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] The token cache is being invalidate because project 6cf005ac328a448d859515920b304f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:21:23.983307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.984274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:23.986353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1045/2069] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:21:23 2022] DELETE /identity/v3/projects/6cf005ac328a448d859515920b304f57 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:23.992722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:23.994279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:24.010327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098130a-dd8d-4fdb-9679-68875d978be8 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:24.077932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:24.079154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:24.079684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:24.080171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] PATH_INFO: `/v3/users/5ac951cd18ba4686832b702bb8e34b30` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:24.082841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac951cd18ba4686832b702bb8e34b30)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:24.085462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:24.298232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac951cd18ba4686832b702bb8e34b30'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:24.298930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac951cd18ba4686832b702bb8e34b30'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:24.385669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac951cd18ba4686832b702bb8e34b30'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:24.398650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac951cd18ba4686832b702bb8e34b30'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:24.399381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c9b159d0-8e2f-43e7-870a-786d510be054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac951cd18ba4686832b702bb8e34b30'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:24.411328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1025/2070] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:23 2022] DELETE /identity/v3/users/5ac951cd18ba4686832b702bb8e34b30 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:24.901330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:24.902835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:24.919204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fb417-1d3f-4ec6-a51d-3c8d4b5e6baf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.033908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.033908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.034315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.034727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] PATH_INFO: `/v3/projects/375ed27971db4cb5bcb3ca9260a2b0f7` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.036116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375ed27971db4cb5bcb3ca9260a2b0f7)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.039704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:25.166872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375ed27971db4cb5bcb3ca9260a2b0f7', 'request_id': 'req-f4fa5416-69a9-4495-b474-732daa297772'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:25.235639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375ed27971db4cb5bcb3ca9260a2b0f7', 'request_id': 'req-f4fa5416-69a9-4495-b474-732daa297772'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:25.238033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375ed27971db4cb5bcb3ca9260a2b0f7', 'request_id': 'req-f4fa5416-69a9-4495-b474-732daa297772'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:25.249845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] The token cache is being invalidate because project 375ed27971db4cb5bcb3ca9260a2b0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:21:25.250183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:25.250766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f4fa5416-69a9-4495-b474-732daa297772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:25.252278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1046/2071] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:21:24 2022] DELETE /identity/v3/projects/375ed27971db4cb5bcb3ca9260a2b0f7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:25.257970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2ce9e-74b4-48cc-b05e-ddf07081c7e0 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.258420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2ce9e-74b4-48cc-b05e-ddf07081c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.258598 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2ce9e-74b4-48cc-b05e-ddf07081c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.312109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c9a2ce9e-74b4-48cc-b05e-ddf07081c7e0 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:25.316235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c9a2ce9e-74b4-48cc-b05e-ddf07081c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:25.373704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1026/2072] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:21:25.381926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ccb9-ea41-495d-ab98-8c6a01328002 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.382223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ccb9-ea41-495d-ab98-8c6a01328002 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.382505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ccb9-ea41-495d-ab98-8c6a01328002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.405065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-48b5ccb9-ea41-495d-ab98-8c6a01328002 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:25.406447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-48b5ccb9-ea41-495d-ab98-8c6a01328002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:25.416298 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1047/2073] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:25.424505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2ce9e-74b4-48cc-b05e-ddf07081c7e0 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:25.431247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2ce9e-74b4-48cc-b05e-ddf07081c7e0 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.436043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.436664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.437079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.437392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.438225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:21:25.438458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.440063 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:25.453717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1027/2074] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:21:25.462484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ccb9-ea41-495d-ab98-8c6a01328002 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:25.473231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ccb9-ea41-495d-ab98-8c6a01328002 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.478874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c293fc-a315-46a3-9fe7-b14eeebea1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.479394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c293fc-a315-46a3-9fe7-b14eeebea1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.480029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c293fc-a315-46a3-9fe7-b14eeebea1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.480194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c293fc-a315-46a3-9fe7-b14eeebea1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.480934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c293fc-a315-46a3-9fe7-b14eeebea1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.483106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c293fc-a315-46a3-9fe7-b14eeebea1d9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:25.593652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1048/2075] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:21:25 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:21:25.599301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:25.610836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a775c2-886a-423a-ad29-3eaea8e1e3c9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.668068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.668718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.669001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.669269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.669890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.672394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:25.675332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.675539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.675828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.696183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:25.697306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:25.753631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1049/2076] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:21:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:21:25.767808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:25.769354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:25.815019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1028/2077] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:21:25 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:21:25.821639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:25.834738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78451ddd-037f-4303-80b5-95519bdc81b6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.843238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.846812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75dc5-e3e8-4e09-859c-cd9e893b7d57 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.846935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.846935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.846935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.846935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.847876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:25.849224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.849922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.850235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.850513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.858948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.859079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1029/2078] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:21:25.860601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:25.863130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:25.869327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1050/2079] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:21:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:21:25.872914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74d4e-a71e-49fa-85e1-d6f1a003fc7c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.878119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc304cb-5a2f-4335-9f6e-f15c9ed00314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.881186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc304cb-5a2f-4335-9f6e-f15c9ed00314 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.881186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc304cb-5a2f-4335-9f6e-f15c9ed00314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.881186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc304cb-5a2f-4335-9f6e-f15c9ed00314 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.881186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc304cb-5a2f-4335-9f6e-f15c9ed00314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.882187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc304cb-5a2f-4335-9f6e-f15c9ed00314 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:25.893056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1030/2080] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:21:25.898753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:25.911264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f050633-f67b-4276-bce7-259cb81a6b1c service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:25.917130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:25.918397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:25.918913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:25.919312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] PATH_INFO: `/v3/projects/c8ed8af489754e22aec1e395a61ef7d6/users/130c4d56a87e45e5ad698786a4c950cc/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:25.941858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ed8af489754e22aec1e395a61ef7d6, user_id=130c4d56a87e45e5ad698786a4c950cc, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:25.948537 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:26.042915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1051/2081] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:25 2022] PUT /identity/v3/projects/c8ed8af489754e22aec1e395a61ef7d6/users/130c4d56a87e45e5ad698786a4c950cc/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:26.054400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7c66-1c23-473c-9284-47530ccb0972 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:26.054925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7c66-1c23-473c-9284-47530ccb0972 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:26.055363 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7c66-1c23-473c-9284-47530ccb0972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:26.104893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f02a7c66-1c23-473c-9284-47530ccb0972 None None] MFA Rules not processed for user `130c4d56a87e45e5ad698786a4c950cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:26.106512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f02a7c66-1c23-473c-9284-47530ccb0972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:26.188140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1031/2082] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:26.192512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:26.298453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6ea2f-8815-42d9-9a33-6cd8a4600d7e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:26.306856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:26.307615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:26.308441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:26.308906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:26.309860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:26.312073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:26.442025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1052/2083] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:21:26 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:21:26.447840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a7c66-1c23-473c-9284-47530ccb0972 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:26.463255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a7c66-1c23-473c-9284-47530ccb0972 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:26.584024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:26.585161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:26.586037 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:26.586560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:26.587552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:26.589636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:26.712582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1032/2084] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:21:26 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:21:26.714043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:26.732416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0070679-fe3b-45e8-ae83-96cb634c515c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:26.746584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:26.747285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:26.747564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:26.747848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:26.748882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:26.750577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:26.782342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1053/2085] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:26.786687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:26.818220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada651b-cb5b-40c5-af2e-36f7bd3d26e0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:26.839122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:26.840998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:26.841267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:26.842167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] PATH_INFO: `/v3/projects/7d7f904aaed5487b9212f42114375388/users/e4789d6dc9d44e8e95b96e4e9f6bc261/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:26.893505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7f904aaed5487b9212f42114375388, user_id=e4789d6dc9d44e8e95b96e4e9f6bc261, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:26.897705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:27.032570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1033/2086] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:26 2022] PUT /identity/v3/projects/7d7f904aaed5487b9212f42114375388/users/e4789d6dc9d44e8e95b96e4e9f6bc261/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:21:27.037979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:27.058672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d06135-8844-4e48-86ab-adb89138b37b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:27.302088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c325da-e529-4439-b6b7-4709fc6db8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:27.302088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c325da-e529-4439-b6b7-4709fc6db8ca admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:27.302088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c325da-e529-4439-b6b7-4709fc6db8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:27.302088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c325da-e529-4439-b6b7-4709fc6db8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:27.302598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c325da-e529-4439-b6b7-4709fc6db8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:27.302598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c325da-e529-4439-b6b7-4709fc6db8ca admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:27.302598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1054/2087] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:27.302915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:27.302915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6c70-e1d6-4b09-976e-b6352940408f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:27.302915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:27.302915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:27.303255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:27.303255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] PATH_INFO: `/v3/projects/7d7f904aaed5487b9212f42114375388/users/e4789d6dc9d44e8e95b96e4e9f6bc261/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:27.304810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7f904aaed5487b9212f42114375388, user_id=e4789d6dc9d44e8e95b96e4e9f6bc261, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:27.308373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:27.324707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1034/2088] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:27 2022] PUT /identity/v3/projects/7d7f904aaed5487b9212f42114375388/users/e4789d6dc9d44e8e95b96e4e9f6bc261/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:27.345294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b84bae-629a-484e-b722-5f5ca83a431f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:27.345902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b84bae-629a-484e-b722-5f5ca83a431f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:27.346398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b84bae-629a-484e-b722-5f5ca83a431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:27.385598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c5b84bae-629a-484e-b722-5f5ca83a431f None None] MFA Rules not processed for user `e4789d6dc9d44e8e95b96e4e9f6bc261`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:27.387268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c5b84bae-629a-484e-b722-5f5ca83a431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:27.485073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1055/2089] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:27.500428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:27.504419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:27.586991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570007-778f-4f29-87aa-eb851b0e3bf4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:27.590807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52843e-9347-4eba-bd54-f0d6955292d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:27.591535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52843e-9347-4eba-bd54-f0d6955292d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:27.591884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52843e-9347-4eba-bd54-f0d6955292d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:27.592231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52843e-9347-4eba-bd54-f0d6955292d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:27.602122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52843e-9347-4eba-bd54-f0d6955292d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:27.604819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52843e-9347-4eba-bd54-f0d6955292d0 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:27.617737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1035/2090] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:29.140529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b84bae-629a-484e-b722-5f5ca83a431f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:29.217920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b84bae-629a-484e-b722-5f5ca83a431f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:29.239998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:29.239998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:29.239998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:29.239998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] PATH_INFO: `/v3/users/130c4d56a87e45e5ad698786a4c950cc` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:29.240956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=130c4d56a87e45e5ad698786a4c950cc)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:29.240956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:29.797245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130c4d56a87e45e5ad698786a4c950cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:29.797970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130c4d56a87e45e5ad698786a4c950cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:29.816118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130c4d56a87e45e5ad698786a4c950cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:29.962490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130c4d56a87e45e5ad698786a4c950cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:29.963090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130c4d56a87e45e5ad698786a4c950cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:30.004758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1056/2091] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:29 2022] DELETE /identity/v3/users/130c4d56a87e45e5ad698786a4c950cc => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:30.006935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:30.007441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:30.007441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:30.042746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:30.046134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:30.166973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1036/2092] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:30.177584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:30.179284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:30.302149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933e4b-5e1a-4ca6-813c-d233a13ad4bc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:30.306446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:30.307433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:30.308923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:30.309463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:30.321155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:30.323249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:30.334918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1057/2093] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:21:31.099723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:31.104932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:31.132517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f94fe7-02b0-421e-af64-3dd848dc5030 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:31.151824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:31.154962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:31.159893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:31.160360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] PATH_INFO: `/v3/projects/c8ed8af489754e22aec1e395a61ef7d6` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:31.167376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ed8af489754e22aec1e395a61ef7d6)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:31.175985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:31.326764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ed8af489754e22aec1e395a61ef7d6', 'request_id': 'req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:31.409408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ed8af489754e22aec1e395a61ef7d6', 'request_id': 'req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:31.431710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ed8af489754e22aec1e395a61ef7d6', 'request_id': 'req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:31.458919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] The token cache is being invalidate because project c8ed8af489754e22aec1e395a61ef7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:21:31.460240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:31.461611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:31.466723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1037/2094] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:21:31 2022] DELETE /identity/v3/projects/c8ed8af489754e22aec1e395a61ef7d6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:31.468038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:31.483387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d60ec-08ea-4c50-8480-ee160432bbb9 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:31.643641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:31.644533 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:31.644816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:31.645403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] PATH_INFO: `/v3/users/e4789d6dc9d44e8e95b96e4e9f6bc261` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:31.646732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4789d6dc9d44e8e95b96e4e9f6bc261)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:31.649669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:32.020454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4789d6dc9d44e8e95b96e4e9f6bc261'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:32.022408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4789d6dc9d44e8e95b96e4e9f6bc261'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:32.043058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4789d6dc9d44e8e95b96e4e9f6bc261'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:32.157319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4789d6dc9d44e8e95b96e4e9f6bc261'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:32.161876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9f696ee4-cc76-4b97-844b-ffd5fe9a323e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4789d6dc9d44e8e95b96e4e9f6bc261'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:32.174213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1058/2095] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:31 2022] DELETE /identity/v3/users/e4789d6dc9d44e8e95b96e4e9f6bc261 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:32.693586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:32.693586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:32.712469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e011fb2-bdb9-476c-a7cb-0e1dcc31d7cb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:32.838315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:32.848401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:32.848401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:32.848401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] PATH_INFO: `/v3/projects/7d7f904aaed5487b9212f42114375388` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:32.848401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7f904aaed5487b9212f42114375388)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:32.848401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:33.227622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7f904aaed5487b9212f42114375388', 'request_id': 'req-f5fc4ab1-a99d-4b39-b126-05df21c62748'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:33.614125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7f904aaed5487b9212f42114375388', 'request_id': 'req-f5fc4ab1-a99d-4b39-b126-05df21c62748'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:33.621215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7f904aaed5487b9212f42114375388', 'request_id': 'req-f5fc4ab1-a99d-4b39-b126-05df21c62748'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:33.631899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] The token cache is being invalidate because project 7d7f904aaed5487b9212f42114375388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:21:33.632185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:33.632824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f5fc4ab1-a99d-4b39-b126-05df21c62748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:33.634379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1038/2096] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:21:32 2022] DELETE /identity/v3/projects/7d7f904aaed5487b9212f42114375388 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:33.639325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a289d1-7927-4445-ab5e-c600ba3a911d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:33.639817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a289d1-7927-4445-ab5e-c600ba3a911d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:33.639922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a289d1-7927-4445-ab5e-c600ba3a911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:33.667872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-23a289d1-7927-4445-ab5e-c600ba3a911d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:33.669109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-23a289d1-7927-4445-ab5e-c600ba3a911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:33.743892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1059/2097] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:21:33.745890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab46097-ad08-48b2-9bb8-4d0d01be65dd None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:33.756681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab46097-ad08-48b2-9bb8-4d0d01be65dd None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:33.756681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab46097-ad08-48b2-9bb8-4d0d01be65dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:33.769352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-3ab46097-ad08-48b2-9bb8-4d0d01be65dd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:33.770586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3ab46097-ad08-48b2-9bb8-4d0d01be65dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:33.778996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1039/2098] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:33.784415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a289d1-7927-4445-ab5e-c600ba3a911d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:33.795594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a289d1-7927-4445-ab5e-c600ba3a911d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:33.805967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:33.806646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:33.806944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:33.807248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:33.808023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:21:33.808333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:33.810209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:33.834133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1060/2099] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:21:33.835848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab46097-ad08-48b2-9bb8-4d0d01be65dd None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:33.845782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab46097-ad08-48b2-9bb8-4d0d01be65dd None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:33.852134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:33.852837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:33.853344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:33.853636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:33.854373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:33.856603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:33.978147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1040/2100] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:21:33 2022] POST /identity/v3/projects => generated 355 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:21:33.982222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:33.995080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1053f-6ae7-4fdb-b4e3-472992584b6d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:34.089850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:34.090542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:34.090831 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:34.091113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:34.091829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:34.093823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:34.189339 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1061/2101] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:21:33 2022] POST /identity/v3/users => generated 278 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:21:34.192156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:34.203054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f87fdd-847b-4d97-bd31-a524530d7aac admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:34.212706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:34.214650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:34.215688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:34.216274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:34.217669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:34.219601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:34.240726 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1041/2102] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:34.242275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:34.256059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eaca3-7619-4a5c-ab33-ffd506f4a899 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:34.268571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524c4c4-29f5-4810-8fa1-7179181d2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:34.273469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524c4c4-29f5-4810-8fa1-7179181d2671 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:34.273789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524c4c4-29f5-4810-8fa1-7179181d2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:34.274074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524c4c4-29f5-4810-8fa1-7179181d2671 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:34.274844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524c4c4-29f5-4810-8fa1-7179181d2671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:34.310680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524c4c4-29f5-4810-8fa1-7179181d2671 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:34.325699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1062/2103] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:34.331959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:34.353128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e4ff2-4944-4949-8b5a-543d8ea7410e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:34.358489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:34.359742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:34.360179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:34.360709 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] PATH_INFO: `/v3/projects/18514af3a01548e7b8ae5f50357a5095/users/873144abc4b146e396d0dd9d07311c21/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:34.382010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18514af3a01548e7b8ae5f50357a5095, user_id=873144abc4b146e396d0dd9d07311c21, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:34.385506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:34.486102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13e27-5fff-4edb-988c-1b6c8a548db4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:34.486102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13e27-5fff-4edb-988c-1b6c8a548db4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:34.486102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13e27-5fff-4edb-988c-1b6c8a548db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:34.487232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1042/2104] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:34 2022] PUT /identity/v3/projects/18514af3a01548e7b8ae5f50357a5095/users/873144abc4b146e396d0dd9d07311c21/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:34.543254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e6a13e27-5fff-4edb-988c-1b6c8a548db4 None None] MFA Rules not processed for user `873144abc4b146e396d0dd9d07311c21`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:34.545342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e6a13e27-5fff-4edb-988c-1b6c8a548db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:34.676692 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:34.678770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1063/2105] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:34 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:34.813229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7158aa-f55c-4ff3-8490-931485e4af44 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:34.818138 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:34.819379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:34.819780 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:34.819913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:34.820693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:34.822625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:34.927359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1043/2106] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:21:34 2022] POST /identity/v3/projects => generated 355 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:21:34.931600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13e27-5fff-4edb-988c-1b6c8a548db4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:34.948890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13e27-5fff-4edb-988c-1b6c8a548db4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:35.019373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:35.021018 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:35.022017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:35.022645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:35.023944 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:35.027457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:35.129855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1064/2107] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:21:34 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:21:35.134269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:35.157650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae0c35-96f7-4504-8187-124d3fad1b4d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:35.163602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:35.164263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:35.164543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:35.164821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:35.165598 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:35.167198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:35.187813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1044/2108] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:35.189166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:35.204465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697328b5-1f36-4b44-9949-b44eb2165ba4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:35.216150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:35.218008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:35.218403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:35.218981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] PATH_INFO: `/v3/projects/abbeec749c204bf599a6e01c49eb78f1/users/5a7721111c9147b4b67e54e12e160a6a/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:35.240352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbeec749c204bf599a6e01c49eb78f1, user_id=5a7721111c9147b4b67e54e12e160a6a, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:35.246159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:35.324381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1065/2109] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:35 2022] PUT /identity/v3/projects/abbeec749c204bf599a6e01c49eb78f1/users/5a7721111c9147b4b67e54e12e160a6a/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:35.328935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:35.339680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d53a9-7d88-4f37-a4e8-1d5094b6aed5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:35.446424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bd89c-9826-4d73-8cd1-ab4ec7074395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:35.449846 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bd89c-9826-4d73-8cd1-ab4ec7074395 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:35.450532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bd89c-9826-4d73-8cd1-ab4ec7074395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:35.451050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bd89c-9826-4d73-8cd1-ab4ec7074395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:35.453010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bd89c-9826-4d73-8cd1-ab4ec7074395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:35.455263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bd89c-9826-4d73-8cd1-ab4ec7074395 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:35.469383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1045/2110] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:21:35.471431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:35.492311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10053cc-245a-4f40-8508-da4de68fe48d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:35.508605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:35.509789 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:35.510284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:35.510681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] PATH_INFO: `/v3/projects/abbeec749c204bf599a6e01c49eb78f1/users/5a7721111c9147b4b67e54e12e160a6a/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:35.513208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbeec749c204bf599a6e01c49eb78f1, user_id=5a7721111c9147b4b67e54e12e160a6a, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:35.516453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:35.543876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1066/2111] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:21:35 2022] PUT /identity/v3/projects/abbeec749c204bf599a6e01c49eb78f1/users/5a7721111c9147b4b67e54e12e160a6a/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:35.545625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:35.546031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:35.546196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:35.580630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] MFA Rules not processed for user `5a7721111c9147b4b67e54e12e160a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:35.581908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:35.720167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1046/2112] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:35 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:21:35.734937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:35.737373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:35.834263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655aba9-3e9a-4301-b89d-21bf100fc43d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:35.838895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:35.839569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:35.840085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:35.840243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:35.854892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:35.856368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:35.869200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1067/2113] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:35 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:36.158398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:36.160506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:36.175022 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d710ef4-ce3b-4a50-9e83-b17364868a67 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:36.180815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e2ba-065d-46b2-b3d9-3d6a6a804103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:36.181493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e2ba-065d-46b2-b3d9-3d6a6a804103 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:36.181835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e2ba-065d-46b2-b3d9-3d6a6a804103 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:36.182263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e2ba-065d-46b2-b3d9-3d6a6a804103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:36.261884 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e2ba-065d-46b2-b3d9-3d6a6a804103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:36.263395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e2ba-065d-46b2-b3d9-3d6a6a804103 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:36.274582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1047/2114] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:36 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:39.355922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:39.359918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:39.422431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eafaa3-c2c2-4bc3-940f-4cfe1823b834 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:39.426283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503923-1192-47a4-b420-0292f43b2b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:39.426953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503923-1192-47a4-b420-0292f43b2b11 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:39.427235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503923-1192-47a4-b420-0292f43b2b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:39.428058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503923-1192-47a4-b420-0292f43b2b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:39.430011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c0503923-1192-47a4-b420-0292f43b2b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:39.498536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503923-1192-47a4-b420-0292f43b2b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:39.500036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503923-1192-47a4-b420-0292f43b2b11 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:39.511988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1068/2115] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:46.527919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cf1f8-ff6d-47c3-ae75-f8bec033143d None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:46.528511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cf1f8-ff6d-47c3-ae75-f8bec033143d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:46.528511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cf1f8-ff6d-47c3-ae75-f8bec033143d None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:46.531331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1048/2116] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:21:46.544153 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294717dc-755d-4489-882b-47b0b08f73a6 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:46.544646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294717dc-755d-4489-882b-47b0b08f73a6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:46.545072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294717dc-755d-4489-882b-47b0b08f73a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:46.674934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-294717dc-755d-4489-882b-47b0b08f73a6 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:46.676172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-294717dc-755d-4489-882b-47b0b08f73a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:46.885305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1069/2117] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:46.898600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cf1f8-ff6d-47c3-ae75-f8bec033143d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:46.900642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-622cf1f8-ff6d-47c3-ae75-f8bec033143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:46.969153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cf1f8-ff6d-47c3-ae75-f8bec033143d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:46.973029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b4dbc-1354-4e6c-adfc-e3cf8eee2b4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:46.973720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4dbc-1354-4e6c-adfc-e3cf8eee2b4c service glance] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:46.974007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4dbc-1354-4e6c-adfc-e3cf8eee2b4c service glance] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:46.974319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b4dbc-1354-4e6c-adfc-e3cf8eee2b4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:46.986694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b4dbc-1354-4e6c-adfc-e3cf8eee2b4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:46.988181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b4dbc-1354-4e6c-adfc-e3cf8eee2b4c service glance] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:47.000145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1049/2118] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:47.278266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9971-5d1f-4cbb-82dd-f5ec38e1cc3d None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:47.278266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9971-5d1f-4cbb-82dd-f5ec38e1cc3d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:47.278266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf9971-5d1f-4cbb-82dd-f5ec38e1cc3d None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:47.280256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1070/2119] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:21:47.285492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1f864-bb78-42d9-a1b3-83e8e5b0fcfb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:47.285787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1f864-bb78-42d9-a1b3-83e8e5b0fcfb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:47.286167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1f864-bb78-42d9-a1b3-83e8e5b0fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:47.316567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fae1f864-bb78-42d9-a1b3-83e8e5b0fcfb None None] MFA Rules not processed for user `5157463790394bcbae9c0d7e5812f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:47.317893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fae1f864-bb78-42d9-a1b3-83e8e5b0fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:47.330497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1050/2120] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:21:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:47.344607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf9971-5d1f-4cbb-82dd-f5ec38e1cc3d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:47.355956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf9971-5d1f-4cbb-82dd-f5ec38e1cc3d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:47.359702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87847866-b46f-49c7-9c78-bda4432ad339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:47.360436 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847866-b46f-49c7-9c78-bda4432ad339 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:47.360638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847866-b46f-49c7-9c78-bda4432ad339 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:47.360968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87847866-b46f-49c7-9c78-bda4432ad339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:47.368655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87847866-b46f-49c7-9c78-bda4432ad339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:47.370481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87847866-b46f-49c7-9c78-bda4432ad339 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:47.378471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1071/2121] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:47.468479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc02a2a-fce4-43c8-8660-800beafda8ca None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:47.468776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc02a2a-fce4-43c8-8660-800beafda8ca None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:47.469053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc02a2a-fce4-43c8-8660-800beafda8ca None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:47.470910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1051/2122] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:21:47.476429 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f4e2-8e92-40b7-9970-39018dff8834 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:47.476829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f4e2-8e92-40b7-9970-39018dff8834 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:47.477136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f4e2-8e92-40b7-9970-39018dff8834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:47.500880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b039f4e2-8e92-40b7-9970-39018dff8834 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:47.502148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b039f4e2-8e92-40b7-9970-39018dff8834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:47.514265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1072/2123] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:21:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:47.526533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc02a2a-fce4-43c8-8660-800beafda8ca None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:47.537515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc02a2a-fce4-43c8-8660-800beafda8ca None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:47.541455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:47.542125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:47.542408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:47.542681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:47.552826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:47.554704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:47.568274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1052/2124] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:21:52.137738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9607a8-1635-4583-903e-96b8a7ec95c3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:52.138253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9607a8-1635-4583-903e-96b8a7ec95c3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:52.138448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9607a8-1635-4583-903e-96b8a7ec95c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:52.156733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-8f9607a8-1635-4583-903e-96b8a7ec95c3 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:52.159451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8f9607a8-1635-4583-903e-96b8a7ec95c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:52.214045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1073/2125] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:21:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:52.235498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:52.236868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:52.308129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2aefd-9f60-4db6-9c43-d35eebb8f59c service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:52.313385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1df25-892c-40fe-bb87-837a30257880 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:52.314034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1df25-892c-40fe-bb87-837a30257880 service swift] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:52.314345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1df25-892c-40fe-bb87-837a30257880 service swift] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:52.314712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1df25-892c-40fe-bb87-837a30257880 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:52.326502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1df25-892c-40fe-bb87-837a30257880 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:52.329480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1df25-892c-40fe-bb87-837a30257880 service swift] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:52.345646 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1053/2126] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:21:59.108966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9607a8-1635-4583-903e-96b8a7ec95c3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:59.187708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9607a8-1635-4583-903e-96b8a7ec95c3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:59.192383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:59.193346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:59.193630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:59.193909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] PATH_INFO: `/v3/users/873144abc4b146e396d0dd9d07311c21` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:59.195245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=873144abc4b146e396d0dd9d07311c21)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:59.197210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:59.381444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873144abc4b146e396d0dd9d07311c21'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:59.382733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873144abc4b146e396d0dd9d07311c21'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:59.394529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873144abc4b146e396d0dd9d07311c21'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:59.454131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873144abc4b146e396d0dd9d07311c21'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:59.455048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873144abc4b146e396d0dd9d07311c21'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:21:59.470062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1074/2127] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:21:59 2022] DELETE /identity/v3/users/873144abc4b146e396d0dd9d07311c21 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:21:59.475216 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:59.476318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:59.476318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:59.500480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:21:59.501904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:59.588953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1054/2128] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:21:59.600248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:21:59.600248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:21:59.660396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26cc5a-bd7a-4d8f-a57e-bd4662b817a8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:21:59.664456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:21:59.665438 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:21:59.665971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:21:59.666323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:21:59.679844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:21:59.682956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:21:59.696968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1075/2129] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:00.153316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:00.155027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:00.174304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b729-4c1d-49ac-aff5-913001b8fb61 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:00.179441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:00.180423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:00.180699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:00.180970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] PATH_INFO: `/v3/projects/18514af3a01548e7b8ae5f50357a5095` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:00.182244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] RBAC: Authorizing `identity:delete_project(project_id=18514af3a01548e7b8ae5f50357a5095)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:00.184230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:00.310860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18514af3a01548e7b8ae5f50357a5095', 'request_id': 'req-6525aad4-7342-461e-9acc-706ed113315b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.390966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18514af3a01548e7b8ae5f50357a5095', 'request_id': 'req-6525aad4-7342-461e-9acc-706ed113315b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.397804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18514af3a01548e7b8ae5f50357a5095', 'request_id': 'req-6525aad4-7342-461e-9acc-706ed113315b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.412540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] The token cache is being invalidate because project 18514af3a01548e7b8ae5f50357a5095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:00.412904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.413650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.415767 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1055/2130] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:00 2022] DELETE /identity/v3/projects/18514af3a01548e7b8ae5f50357a5095 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:00.419526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:00.431272 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820252-dce2-4a24-9b85-c7b41e862d60 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:00.501372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:00.502376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:00.502749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:00.503099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] PATH_INFO: `/v3/users/5a7721111c9147b4b67e54e12e160a6a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:00.504416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7721111c9147b4b67e54e12e160a6a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:00.506470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:00.762151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7721111c9147b4b67e54e12e160a6a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.763544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7721111c9147b4b67e54e12e160a6a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.776199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7721111c9147b4b67e54e12e160a6a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.842194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7721111c9147b4b67e54e12e160a6a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.842832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2ce15118-0948-42f9-92e7-46d3516a156c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7721111c9147b4b67e54e12e160a6a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:00.871599 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1076/2131] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:00 2022] DELETE /identity/v3/users/5a7721111c9147b4b67e54e12e160a6a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:01.347252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:01.349716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:01.365201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525aad4-7342-461e-9acc-706ed113315b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:01.445335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:01.446290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:01.446643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:01.446990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] PATH_INFO: `/v3/projects/abbeec749c204bf599a6e01c49eb78f1` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:01.448286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbeec749c204bf599a6e01c49eb78f1)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:01.450566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:01.602789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbeec749c204bf599a6e01c49eb78f1', 'request_id': 'req-dcfec4fb-65b0-40c7-a406-1944373d6953'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:01.685900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbeec749c204bf599a6e01c49eb78f1', 'request_id': 'req-dcfec4fb-65b0-40c7-a406-1944373d6953'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:01.695868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbeec749c204bf599a6e01c49eb78f1', 'request_id': 'req-dcfec4fb-65b0-40c7-a406-1944373d6953'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:01.718532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] The token cache is being invalidate because project abbeec749c204bf599a6e01c49eb78f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:01.718532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:01.718532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcfec4fb-65b0-40c7-a406-1944373d6953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:01.718532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1056/2132] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:01 2022] DELETE /identity/v3/projects/abbeec749c204bf599a6e01c49eb78f1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:01.719487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f445b-ed7a-420d-812e-4b7be4269972 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:01.719970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f445b-ed7a-420d-812e-4b7be4269972 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:01.720183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f445b-ed7a-420d-812e-4b7be4269972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:01.740970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4c1f445b-ed7a-420d-812e-4b7be4269972 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:01.742856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4c1f445b-ed7a-420d-812e-4b7be4269972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:01.804967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1077/2133] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:01.813934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9727c-53c2-4276-99ad-b58d35b0f69f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:01.814262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9727c-53c2-4276-99ad-b58d35b0f69f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:01.814498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9727c-53c2-4276-99ad-b58d35b0f69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:01.843092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-32e9727c-53c2-4276-99ad-b58d35b0f69f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:01.860567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-32e9727c-53c2-4276-99ad-b58d35b0f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:01.872098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1057/2134] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:01.876684 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f445b-ed7a-420d-812e-4b7be4269972 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:01.888308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f445b-ed7a-420d-812e-4b7be4269972 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:01.893887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:01.894552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:01.894832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:01.895104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:01.895905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:01.896210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:01.897879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:01.911013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1078/2135] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:22:01.915360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9727c-53c2-4276-99ad-b58d35b0f69f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:01.924963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9727c-53c2-4276-99ad-b58d35b0f69f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:01.930535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:01.930954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:01.931253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:01.931538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:01.932247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:01.934496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:02.041579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1058/2136] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:01 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:02.045798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:02.056143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65931fc7-ecfd-4064-a05e-ccc5a400d8cb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:02.119889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:02.120572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:02.120859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:02.121138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:02.121899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:02.123896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:02.251455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1079/2137] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:02 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:02.258965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:02.270218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2631-18ad-4a1f-b009-44461ea34185 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:02.275385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:02.279535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:02.279535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:02.279535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:02.279535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:02.279535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:02.301096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1059/2138] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:02.305529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:02.317634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79191e24-2c7e-4779-9f42-7f37cae45511 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:02.327719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93500d-049b-4282-9d2d-c3573cbabaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:02.328815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93500d-049b-4282-9d2d-c3573cbabaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:02.329258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93500d-049b-4282-9d2d-c3573cbabaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:02.329704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93500d-049b-4282-9d2d-c3573cbabaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:02.330824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93500d-049b-4282-9d2d-c3573cbabaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:02.332929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93500d-049b-4282-9d2d-c3573cbabaf9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:02.348453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1080/2139] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:02.349932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:02.361070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d63f7-ee58-47fe-965c-ca92a52241cc admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:02.367604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:02.368506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:02.368858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:02.369149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] PATH_INFO: `/v3/projects/72e7468a4b7249c9be4d89b2e7c10e7b/users/f57fcd1c00b843668da8c67340003681/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:02.389722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e7468a4b7249c9be4d89b2e7c10e7b, user_id=f57fcd1c00b843668da8c67340003681, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:02.393108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:02.474183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1060/2140] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:02 2022] PUT /identity/v3/projects/72e7468a4b7249c9be4d89b2e7c10e7b/users/f57fcd1c00b843668da8c67340003681/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:02.484710 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b367d31-da89-4a9b-84e1-996af6e70ab0 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:02.485037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b367d31-da89-4a9b-84e1-996af6e70ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:02.485390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b367d31-da89-4a9b-84e1-996af6e70ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:02.514358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6b367d31-da89-4a9b-84e1-996af6e70ab0 None None] MFA Rules not processed for user `f57fcd1c00b843668da8c67340003681`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:02.515597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6b367d31-da89-4a9b-84e1-996af6e70ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:02.583607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1081/2141] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:02.587883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:02.659123 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb722-571c-4dda-93f6-90801d8b6dbd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:02.665694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:02.666352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:02.666718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:02.667002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:02.667707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:02.669687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:02.787211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1061/2142] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:02 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:02.792262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b367d31-da89-4a9b-84e1-996af6e70ab0 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:02.805721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b367d31-da89-4a9b-84e1-996af6e70ab0 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:02.882721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:02.883487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:02.883860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:02.884234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:02.885049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:02.887130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:03.031308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1082/2143] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:02 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:03.035106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:03.047997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712dea-fcbc-4d84-931e-175cb93a5bc9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:03.053199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:03.054765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:03.055130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:03.055409 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:03.056172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:03.057878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:03.076273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1062/2144] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:03.080745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:03.092019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75559fb-bcc4-4406-8d32-02c0394f303a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:03.096822 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:03.097828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:03.098188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:03.098539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] PATH_INFO: `/v3/projects/793e50837cb742c6bd15e0d8bf011c10/users/c5683c5566f2405289b747372fa7d688/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:03.114763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793e50837cb742c6bd15e0d8bf011c10, user_id=c5683c5566f2405289b747372fa7d688, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:03.118695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:03.202435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1083/2145] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:03 2022] PUT /identity/v3/projects/793e50837cb742c6bd15e0d8bf011c10/users/c5683c5566f2405289b747372fa7d688/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:03.206180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:03.216699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122372-3830-4cf3-875c-c841e3224aa8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:03.290700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e71025-031a-4f8d-b8b9-3dc11d2d574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:03.291385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71025-031a-4f8d-b8b9-3dc11d2d574b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:03.291664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71025-031a-4f8d-b8b9-3dc11d2d574b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:03.291940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e71025-031a-4f8d-b8b9-3dc11d2d574b admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:03.292698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71025-031a-4f8d-b8b9-3dc11d2d574b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:03.294510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e71025-031a-4f8d-b8b9-3dc11d2d574b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:03.306494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1063/2146] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:03.310759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:03.323739 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44457-4fb0-4377-b30e-1a2e1909fa27 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:03.329869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:03.330891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:03.331242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:03.331741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] PATH_INFO: `/v3/projects/793e50837cb742c6bd15e0d8bf011c10/users/c5683c5566f2405289b747372fa7d688/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:03.334006 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793e50837cb742c6bd15e0d8bf011c10, user_id=c5683c5566f2405289b747372fa7d688, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:03.337347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:03.359818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1084/2147] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:03 2022] PUT /identity/v3/projects/793e50837cb742c6bd15e0d8bf011c10/users/c5683c5566f2405289b747372fa7d688/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:03.361736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b570-d376-42f3-b68c-6c2de1c6d119 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:03.362356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b570-d376-42f3-b68c-6c2de1c6d119 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:03.362460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912b570-d376-42f3-b68c-6c2de1c6d119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:03.392686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c912b570-d376-42f3-b68c-6c2de1c6d119 None None] MFA Rules not processed for user `c5683c5566f2405289b747372fa7d688`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:03.393987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c912b570-d376-42f3-b68c-6c2de1c6d119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:03.503668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1064/2148] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:03.511231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:03.512741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:03.653541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec63181-7228-4e64-a657-27cad33b7924 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:03.657395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcaa58-658b-4f72-94bd-cdbf7656f239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:03.658085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcaa58-658b-4f72-94bd-cdbf7656f239 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:03.658444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcaa58-658b-4f72-94bd-cdbf7656f239 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:03.658646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcaa58-658b-4f72-94bd-cdbf7656f239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:03.718294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcaa58-658b-4f72-94bd-cdbf7656f239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:03.719811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcaa58-658b-4f72-94bd-cdbf7656f239 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:03.729699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1085/2149] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:05.450998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ee04-c02f-440f-a21e-20e6e4496141 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:05.453356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ee04-c02f-440f-a21e-20e6e4496141 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:05.453356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4ee04-c02f-440f-a21e-20e6e4496141 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:05.453554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1065/2150] 10.222.0.31 () {54 vars in 960 bytes} [Sat Feb 12 04:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:22:05.458717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:05.459208 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:05.459425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:05.526835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] MFA Rules not processed for user `8156242719464c85ae77a332fe5d5eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:05.528334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:05.613435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1086/2151] 10.222.0.31 () {58 vars in 1057 bytes} [Sat Feb 12 04:22:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:05.624056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ee04-c02f-440f-a21e-20e6e4496141 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:05.642950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4ee04-c02f-440f-a21e-20e6e4496141 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:05.654622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2f3e7-4631-4a6a-9dab-db8d4eb5350c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:05.655323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f3e7-4631-4a6a-9dab-db8d4eb5350c service placement] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:05.660207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f3e7-4631-4a6a-9dab-db8d4eb5350c service placement] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:05.661984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2f3e7-4631-4a6a-9dab-db8d4eb5350c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:05.666896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ecc2f3e7-4631-4a6a-9dab-db8d4eb5350c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:05.685611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2f3e7-4631-4a6a-9dab-db8d4eb5350c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:05.687589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2f3e7-4631-4a6a-9dab-db8d4eb5350c service placement] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:05.698525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1066/2152] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:10.194456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:10.195941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:10.206973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286184ed-4441-4ec2-bbd8-f357f4544c33 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:10.210630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:10.211260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:10.211540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:10.211852 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:10.220952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:10.222487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:10.232522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1087/2153] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:26.965183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:26.965682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:26.965806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:27.023823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:27.024966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:27.091587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1067/2154] 10.222.0.31 () {58 vars in 967 bytes} [Sat Feb 12 04:22:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:27.105965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:27.107382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:27.224526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb815-0bc3-4232-b145-ec2148beba4d service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:27.232779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:27.233910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:27.233910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:27.234074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:27.244319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:27.246014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:27.259559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1088/2155] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:22:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:22:31.564321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:31.565787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:31.630712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaf287-c4bb-428b-a1e5-9479d1d63f96 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:31.635251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:31.636100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:31.636380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:31.636654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] PATH_INFO: `/v3/users/12659c94a0e54cb885e5398cd4ce4469` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:31.638177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12659c94a0e54cb885e5398cd4ce4469)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:31.640134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:31.863675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12659c94a0e54cb885e5398cd4ce4469'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:31.864451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12659c94a0e54cb885e5398cd4ce4469'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:31.945223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12659c94a0e54cb885e5398cd4ce4469'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:31.958301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12659c94a0e54cb885e5398cd4ce4469'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:31.958972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-d71bd112-c051-4895-aca4-e0628fed1636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12659c94a0e54cb885e5398cd4ce4469'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:31.972481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1068/2156] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:31 2022] DELETE /identity/v3/users/12659c94a0e54cb885e5398cd4ce4469 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:32.192796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:32.219047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2cb0a-fa97-4bc9-aace-5d4c358c9254 service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:32.281459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:32.282581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.283193 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.283610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] PATH_INFO: `/v3/projects/b322dc86ac594838a4aebaf0645d9c21` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.285256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b322dc86ac594838a4aebaf0645d9c21)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:32.286959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:32.423468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b322dc86ac594838a4aebaf0645d9c21', 'request_id': 'req-256e73a4-bcee-41c1-90d6-3d520d9f725c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:32.488172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b322dc86ac594838a4aebaf0645d9c21', 'request_id': 'req-256e73a4-bcee-41c1-90d6-3d520d9f725c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:32.494926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b322dc86ac594838a4aebaf0645d9c21', 'request_id': 'req-256e73a4-bcee-41c1-90d6-3d520d9f725c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:32.506979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] The token cache is being invalidate because project b322dc86ac594838a4aebaf0645d9c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:32.507312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:32.507983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-256e73a4-bcee-41c1-90d6-3d520d9f725c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:32.510132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1089/2157] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:32 2022] DELETE /identity/v3/projects/b322dc86ac594838a4aebaf0645d9c21 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:32.515113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385f57e-f7b1-47b6-bd8a-d23db6592f7e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.515405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385f57e-f7b1-47b6-bd8a-d23db6592f7e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.515686 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385f57e-f7b1-47b6-bd8a-d23db6592f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.542273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f385f57e-f7b1-47b6-bd8a-d23db6592f7e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:32.543565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f385f57e-f7b1-47b6-bd8a-d23db6592f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:32.611817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1069/2158] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:32.620289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144b774-e5b5-4923-8883-595c01a0ede3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.620590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144b774-e5b5-4923-8883-595c01a0ede3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.620897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144b774-e5b5-4923-8883-595c01a0ede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.640512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0144b774-e5b5-4923-8883-595c01a0ede3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:32.641760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0144b774-e5b5-4923-8883-595c01a0ede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:32.649653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1090/2159] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:32.653868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385f57e-f7b1-47b6-bd8a-d23db6592f7e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:32.664882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385f57e-f7b1-47b6-bd8a-d23db6592f7e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:32.671553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:32.672208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.672491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.672769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.673546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:32.673857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:32.675531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:32.687589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1070/2160] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:22:32.691748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144b774-e5b5-4923-8883-595c01a0ede3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:32.700923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144b774-e5b5-4923-8883-595c01a0ede3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:32.705667 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:32.706308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.706595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.706875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.707586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:32.709481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:32.786121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1091/2161] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:32 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:32.790318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:32.800727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aff5cf-d469-4cc8-b397-626265d5fda4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:32.856372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:32.860405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.860405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.860405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.860405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:32.860405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:32.927866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1071/2162] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:32 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:32.932456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:32.943027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584431cd-a5cd-4505-baac-f3185843115f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:32.947720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:32.948371 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.948655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.948931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.949733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:32.951319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:32.961559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1092/2163] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:32.965343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:32.974976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f28f-7a94-4113-a1e6-cce14267b5db admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:32.980114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf6410-4f96-4ba9-9a26-14955e8be41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:32.980996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6410-4f96-4ba9-9a26-14955e8be41d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:32.981312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6410-4f96-4ba9-9a26-14955e8be41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:32.981595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6410-4f96-4ba9-9a26-14955e8be41d admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:32.982327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf6410-4f96-4ba9-9a26-14955e8be41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:32.983937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf6410-4f96-4ba9-9a26-14955e8be41d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:32.994491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1072/2164] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:32.998679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:33.008647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b79a7-0872-4990-877f-c5bd764b674b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:33.013425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:33.014309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:33.014593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:33.014869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] PATH_INFO: `/v3/projects/5ab7c55949374f38b2f033c8aa65e913/users/a0e90386d72a4b9986bad08cd4a76e0c/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:33.029473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab7c55949374f38b2f033c8aa65e913, user_id=a0e90386d72a4b9986bad08cd4a76e0c, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:33.032108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:33.097815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1093/2165] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:32 2022] PUT /identity/v3/projects/5ab7c55949374f38b2f033c8aa65e913/users/a0e90386d72a4b9986bad08cd4a76e0c/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:33.108631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3081-d8f3-4d22-b7da-6c3f85b032c5 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:33.108939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3081-d8f3-4d22-b7da-6c3f85b032c5 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:33.109226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3081-d8f3-4d22-b7da-6c3f85b032c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:33.134792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e26b3081-d8f3-4d22-b7da-6c3f85b032c5 None None] MFA Rules not processed for user `a0e90386d72a4b9986bad08cd4a76e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:33.135988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e26b3081-d8f3-4d22-b7da-6c3f85b032c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:33.197239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1073/2166] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:33.207726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:33.209532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:33.282314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f16de2-2cc6-44d0-80b3-676b997153c8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:33.288493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b1ec-5acd-48af-8167-a2166102bf46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:33.289142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b1ec-5acd-48af-8167-a2166102bf46 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:33.289467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b1ec-5acd-48af-8167-a2166102bf46 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:33.289750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b1ec-5acd-48af-8167-a2166102bf46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:33.298182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b1ec-5acd-48af-8167-a2166102bf46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:33.299753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b1ec-5acd-48af-8167-a2166102bf46 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:33.308598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1094/2167] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:33.481849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b3081-d8f3-4d22-b7da-6c3f85b032c5 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:33.542068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b3081-d8f3-4d22-b7da-6c3f85b032c5 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:33.546589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:33.547444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:33.547723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:33.547997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] PATH_INFO: `/v3/users/a0e90386d72a4b9986bad08cd4a76e0c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:33.549222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e90386d72a4b9986bad08cd4a76e0c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:33.551172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:33.811069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e90386d72a4b9986bad08cd4a76e0c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:33.813148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e90386d72a4b9986bad08cd4a76e0c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:33.968205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e90386d72a4b9986bad08cd4a76e0c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:33.983176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e90386d72a4b9986bad08cd4a76e0c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:33.983863 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e90386d72a4b9986bad08cd4a76e0c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:33.997118 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1074/2168] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:33 2022] DELETE /identity/v3/users/a0e90386d72a4b9986bad08cd4a76e0c => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:34.001778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:34.002068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:34.002355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:34.020281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:34.021504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:34.076605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1095/2169] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:34.086519 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:34.087983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:34.143844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd8639-fc75-485b-810d-e4355b58d34f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:34.147396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55949e2-495d-4a6c-ade5-891af0012f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:34.148026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55949e2-495d-4a6c-ade5-891af0012f77 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:34.148308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55949e2-495d-4a6c-ade5-891af0012f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:34.148577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55949e2-495d-4a6c-ade5-891af0012f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:34.157755 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55949e2-495d-4a6c-ade5-891af0012f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:34.159189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55949e2-495d-4a6c-ade5-891af0012f77 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:34.168992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1075/2170] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:34.674225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:34.676025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:34.693409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3c10-992f-4b87-92ec-df7e5c67d52f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:34.709609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:34.716792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:34.716792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:34.716792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] PATH_INFO: `/v3/projects/5ab7c55949374f38b2f033c8aa65e913` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:34.716792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab7c55949374f38b2f033c8aa65e913)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:34.716792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:34.853013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab7c55949374f38b2f033c8aa65e913', 'request_id': 'req-ebe12cf5-98cc-4869-926e-fa28a73d4572'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:34.939984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab7c55949374f38b2f033c8aa65e913', 'request_id': 'req-ebe12cf5-98cc-4869-926e-fa28a73d4572'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:34.945874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab7c55949374f38b2f033c8aa65e913', 'request_id': 'req-ebe12cf5-98cc-4869-926e-fa28a73d4572'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:34.957560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] The token cache is being invalidate because project 5ab7c55949374f38b2f033c8aa65e913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:34.957850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:34.958546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ebe12cf5-98cc-4869-926e-fa28a73d4572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:34.960154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1096/2171] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:34 2022] DELETE /identity/v3/projects/5ab7c55949374f38b2f033c8aa65e913 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:34.965777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3f344-bdcc-4e01-bf7d-1c27e2cf43f7 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:34.966263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3f344-bdcc-4e01-bf7d-1c27e2cf43f7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:34.966361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3f344-bdcc-4e01-bf7d-1c27e2cf43f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:34.990253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-7de3f344-bdcc-4e01-bf7d-1c27e2cf43f7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:34.991498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7de3f344-bdcc-4e01-bf7d-1c27e2cf43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:35.055938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1076/2172] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:35.064070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933e3a7-481d-47fc-9058-79451c6cf34f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.065749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933e3a7-481d-47fc-9058-79451c6cf34f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.065749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933e3a7-481d-47fc-9058-79451c6cf34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.084012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9933e3a7-481d-47fc-9058-79451c6cf34f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:35.088174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9933e3a7-481d-47fc-9058-79451c6cf34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:35.093658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1097/2173] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:35.098945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3f344-bdcc-4e01-bf7d-1c27e2cf43f7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:35.109309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3f344-bdcc-4e01-bf7d-1c27e2cf43f7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:35.113972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:35.114606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.114881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.115193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.115920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:35.116222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:35.117868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:35.129773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1077/2174] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:22:35.133922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933e3a7-481d-47fc-9058-79451c6cf34f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:35.143507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933e3a7-481d-47fc-9058-79451c6cf34f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:35.148174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:35.148806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.149088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.149389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.150758 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:35.152640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:35.226757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1098/2175] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:35 2022] POST /identity/v3/projects => generated 403 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:35.230759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:35.241087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95e704-30ec-4a00-a860-db1245b2f221 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:35.295849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:35.296727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.297010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.297303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.298064 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:35.300385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:35.377881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1078/2176] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:35 2022] POST /identity/v3/users => generated 302 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:35.381932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:35.392699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c616d-8e98-4686-ba88-f463505f803b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:35.397233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:35.397907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.398190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.398466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.399198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:35.400777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:35.410834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1099/2177] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:35.414610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:35.424654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d35dcf-004c-4ba9-b863-235d9f056b63 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:35.429215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a76fa-5cef-4d15-8ec4-98739d39a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:35.429900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a76fa-5cef-4d15-8ec4-98739d39a7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.430183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a76fa-5cef-4d15-8ec4-98739d39a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.430458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a76fa-5cef-4d15-8ec4-98739d39a7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.431748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a76fa-5cef-4d15-8ec4-98739d39a7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:35.433398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a76fa-5cef-4d15-8ec4-98739d39a7c3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:35.443880 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1079/2178] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:35.448969 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:35.459677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e178e-8ace-4f9a-958f-b3daa3f01be7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:35.464255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:35.465107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.465417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.465692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] PATH_INFO: `/v3/projects/05fa8a09a30a42fd93ad644a04a7fe5a/users/19589731431d434bb630c6ae44f822b4/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.479511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fa8a09a30a42fd93ad644a04a7fe5a, user_id=19589731431d434bb630c6ae44f822b4, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:35.482350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:35.578100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1100/2179] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:35 2022] PUT /identity/v3/projects/05fa8a09a30a42fd93ad644a04a7fe5a/users/19589731431d434bb630c6ae44f822b4/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:35.583204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170362c-ebb0-42ae-8736-d6e0caa51983 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.583515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170362c-ebb0-42ae-8736-d6e0caa51983 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.583802 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170362c-ebb0-42ae-8736-d6e0caa51983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.601344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6170362c-ebb0-42ae-8736-d6e0caa51983 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:35.602577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6170362c-ebb0-42ae-8736-d6e0caa51983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:35.659035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1080/2180] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:35.669202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:35.671125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:35.729364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7f10f-3856-4b52-b603-513f6cba6d7d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:35.733428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:35.734006 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:35.734290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:35.734593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:35.743727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:35.745698 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:35.756297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1101/2181] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:37.426945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0278-e3b7-4ac7-974d-e8fea554f198 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:37.427426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0278-e3b7-4ac7-974d-e8fea554f198 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:37.427522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0278-e3b7-4ac7-974d-e8fea554f198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:37.453730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-0abe0278-e3b7-4ac7-974d-e8fea554f198 None None] MFA Rules not processed for user `19589731431d434bb630c6ae44f822b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:37.454858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0abe0278-e3b7-4ac7-974d-e8fea554f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:37.518176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1081/2182] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:37.526726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:37.536387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8ff97-bb55-4f44-8dbb-4cc42c266fb5 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:37.540957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:37.541643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:37.541924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:37.542200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:37.542905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:37.544816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:37.804337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1102/2183] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:37 2022] POST /identity/v3/projects => generated 403 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:37.817509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0278-e3b7-4ac7-974d-e8fea554f198 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:37.829014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0278-e3b7-4ac7-974d-e8fea554f198 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:37.883050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:37.883742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:37.884059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:37.884942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:37.885745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:37.887715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:38.005717 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1082/2184] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:37 2022] POST /identity/v3/users => generated 308 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:38.007029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:38.017325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f59f6-308b-4525-ba40-84b2bcdc5916 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:38.022067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:38.022664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:38.022945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:38.023219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:38.024173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:38.025630 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:38.037394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1103/2185] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:38.042237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:38.052323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee21f-a15c-4b40-a5e2-0708be6bf924 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:38.060097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:38.061049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:38.061367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:38.062004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] PATH_INFO: `/v3/projects/2b0f8a86d4bb4555a74e08bfc2045cf3/users/10964b76373046eca58ebbd590761fc6/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:38.076199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0f8a86d4bb4555a74e08bfc2045cf3, user_id=10964b76373046eca58ebbd590761fc6, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:38.078873 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:38.224408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1083/2186] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:38 2022] PUT /identity/v3/projects/2b0f8a86d4bb4555a74e08bfc2045cf3/users/10964b76373046eca58ebbd590761fc6/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:38.228867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:38.238849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2ca5f-b4f1-4e22-8679-4964cfe81cb0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:38.293498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da21022-081c-4393-8bc6-206850532a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:38.294162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da21022-081c-4393-8bc6-206850532a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:38.294444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da21022-081c-4393-8bc6-206850532a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:38.294726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da21022-081c-4393-8bc6-206850532a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:38.295461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da21022-081c-4393-8bc6-206850532a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:38.297149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da21022-081c-4393-8bc6-206850532a5a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:38.311456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1104/2187] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:38.313157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:38.323936 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e94ad4-7d72-45a6-ac3e-366572679f86 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:38.328540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:38.329430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:38.329712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:38.329990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] PATH_INFO: `/v3/projects/2b0f8a86d4bb4555a74e08bfc2045cf3/users/10964b76373046eca58ebbd590761fc6/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:38.331957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0f8a86d4bb4555a74e08bfc2045cf3, user_id=10964b76373046eca58ebbd590761fc6, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:38.334699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:38.345612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1084/2188] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:38 2022] PUT /identity/v3/projects/2b0f8a86d4bb4555a74e08bfc2045cf3/users/10964b76373046eca58ebbd590761fc6/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:39.666746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7601f-b733-476b-b97a-7411eee1a96d None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:39.667244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7601f-b733-476b-b97a-7411eee1a96d None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:39.667324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7601f-b733-476b-b97a-7411eee1a96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:39.693892 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1cc7601f-b733-476b-b97a-7411eee1a96d None None] MFA Rules not processed for user `10964b76373046eca58ebbd590761fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:39.702915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1cc7601f-b733-476b-b97a-7411eee1a96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:39.767382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1105/2189] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:41.368004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:41.433537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94e9e-695c-4f40-9e0b-9cfae73c0218 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:41.440403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:41.441291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:41.441582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:41.441943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] PATH_INFO: `/v3/users/19589731431d434bb630c6ae44f822b4` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:41.443234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19589731431d434bb630c6ae44f822b4)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:41.445161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:41.686850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19589731431d434bb630c6ae44f822b4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:41.687554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19589731431d434bb630c6ae44f822b4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:41.766280 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19589731431d434bb630c6ae44f822b4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:41.778851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19589731431d434bb630c6ae44f822b4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:41.779498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19589731431d434bb630c6ae44f822b4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:41.791343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1085/2190] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:41 2022] DELETE /identity/v3/users/19589731431d434bb630c6ae44f822b4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:42.091681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7601f-b733-476b-b97a-7411eee1a96d None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:42.097097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7601f-b733-476b-b97a-7411eee1a96d None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:42.158565 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:42.159531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:42.159881 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:42.160230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] PATH_INFO: `/v3/projects/05fa8a09a30a42fd93ad644a04a7fe5a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:42.161694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fa8a09a30a42fd93ad644a04a7fe5a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:42.163645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:42.325061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fa8a09a30a42fd93ad644a04a7fe5a', 'request_id': 'req-13dc5010-59b5-4af3-93fa-89ed6652cbd7'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.408528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fa8a09a30a42fd93ad644a04a7fe5a', 'request_id': 'req-13dc5010-59b5-4af3-93fa-89ed6652cbd7'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.414861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fa8a09a30a42fd93ad644a04a7fe5a', 'request_id': 'req-13dc5010-59b5-4af3-93fa-89ed6652cbd7'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.434543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] The token cache is being invalidate because project 05fa8a09a30a42fd93ad644a04a7fe5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:42.434836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.435559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.437110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1106/2191] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:42 2022] DELETE /identity/v3/projects/05fa8a09a30a42fd93ad644a04a7fe5a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:42.441095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:42.444835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:42.455998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3a76-33d1-4d49-b09d-9c3e798a0673 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:42.513347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:42.514215 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:42.514497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:42.514766 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] PATH_INFO: `/v3/users/10964b76373046eca58ebbd590761fc6` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:42.516083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=10964b76373046eca58ebbd590761fc6)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:42.518588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:42.838595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10964b76373046eca58ebbd590761fc6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.839432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10964b76373046eca58ebbd590761fc6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.932600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10964b76373046eca58ebbd590761fc6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.944111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10964b76373046eca58ebbd590761fc6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.944729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5515116c-eaa3-49fc-95dd-b78f96be6baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10964b76373046eca58ebbd590761fc6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:42.956712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1086/2192] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:42 2022] DELETE /identity/v3/users/10964b76373046eca58ebbd590761fc6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:43.215372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:43.216916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:43.231922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc5010-59b5-4af3-93fa-89ed6652cbd7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:43.290943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:43.291805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:43.292083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:43.292358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] PATH_INFO: `/v3/projects/2b0f8a86d4bb4555a74e08bfc2045cf3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:43.293622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0f8a86d4bb4555a74e08bfc2045cf3)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:43.295525 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:43.488487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0f8a86d4bb4555a74e08bfc2045cf3', 'request_id': 'req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:43.579148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0f8a86d4bb4555a74e08bfc2045cf3', 'request_id': 'req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:43.584994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0f8a86d4bb4555a74e08bfc2045cf3', 'request_id': 'req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:43.596518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] The token cache is being invalidate because project 2b0f8a86d4bb4555a74e08bfc2045cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:43.596807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:43.597556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-efd53a13-7f8a-46ff-b9be-0dcfc2f1682e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:43.599314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1107/2193] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:43 2022] DELETE /identity/v3/projects/2b0f8a86d4bb4555a74e08bfc2045cf3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:43.604763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d59cb-8c6b-4edf-9c69-394420ba1b24 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:43.605263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d59cb-8c6b-4edf-9c69-394420ba1b24 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:43.605423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d59cb-8c6b-4edf-9c69-394420ba1b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:43.623500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a24d59cb-8c6b-4edf-9c69-394420ba1b24 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:43.624702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a24d59cb-8c6b-4edf-9c69-394420ba1b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:43.682680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1087/2194] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:43.691444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200cbf-5c66-4e44-9863-33b8fea0fb0c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:43.691979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200cbf-5c66-4e44-9863-33b8fea0fb0c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:43.692263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93200cbf-5c66-4e44-9863-33b8fea0fb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:43.710904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-93200cbf-5c66-4e44-9863-33b8fea0fb0c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:43.712129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-93200cbf-5c66-4e44-9863-33b8fea0fb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:43.720618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1108/2195] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:43.724905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d59cb-8c6b-4edf-9c69-394420ba1b24 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:43.735641 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d59cb-8c6b-4edf-9c69-394420ba1b24 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:43.740794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:43.741494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:43.741793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:43.742056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:43.742801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:43.743105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:43.744976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:43.760374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1088/2196] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:22:43.766827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93200cbf-5c66-4e44-9863-33b8fea0fb0c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:43.772321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93200cbf-5c66-4e44-9863-33b8fea0fb0c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:43.778225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:43.779010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:43.779360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:43.779701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:43.780486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:43.782484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:43.880817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1109/2197] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:43 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:43.883965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:43.894663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805567f-e4cd-486a-b17b-71ffa763be56 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:43.953228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:43.953921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:43.954395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:43.954675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:43.955380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:43.957482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.094534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1089/2198] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:43 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:44.103829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.114551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81404d-2ee2-4219-8a10-c282723c4a38 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:44.128085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:44.128085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.128085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.128085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.128460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:44.128460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.132590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1110/2199] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:44.137122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.147126 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66aa6b-0432-424f-b569-78f7fcf24980 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:44.152395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a478133-416c-4632-b0d1-f66ea0e46291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:44.153051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478133-416c-4632-b0d1-f66ea0e46291 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.153361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478133-416c-4632-b0d1-f66ea0e46291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.153756 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478133-416c-4632-b0d1-f66ea0e46291 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.154564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a478133-416c-4632-b0d1-f66ea0e46291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:44.156229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a478133-416c-4632-b0d1-f66ea0e46291 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.166411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1090/2200] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:44.170697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.180952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fb7e1-9139-42f8-aa8d-b74a5b9f4776 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:44.192327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:44.193387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.193819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.194192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] PATH_INFO: `/v3/projects/42415143b27b48c184428109a9d2f3be/users/47ffad66a655413e9fa1466badd27b6f/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.213337 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42415143b27b48c184428109a9d2f3be, user_id=47ffad66a655413e9fa1466badd27b6f, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:44.218607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.341232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1111/2201] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:44 2022] PUT /identity/v3/projects/42415143b27b48c184428109a9d2f3be/users/47ffad66a655413e9fa1466badd27b6f/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:44.351916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.352208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.352482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.379503 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] MFA Rules not processed for user `47ffad66a655413e9fa1466badd27b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:44.380977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:44.465104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1091/2202] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:44.468738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.535996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d221c-64d1-4225-ac09-0fa63c556618 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:44.540797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:44.541492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.541779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.542063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.542765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:44.544734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.598658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.600362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:44.615533 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a35b4f-a967-4fd1-846f-14f7c3aa673f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:44.620569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:44.621496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.621773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.622042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] PATH_INFO: `/v3/users/e3609a9d4fe144b68a62ad4696301244` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.623277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3609a9d4fe144b68a62ad4696301244)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:44.625167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.660618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1112/2203] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:44 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:44.664543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.725155 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba5579-7696-4b48-a5db-b78f95e7997e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:44.730685 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:44.738203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.738203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.738203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.738203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:44.738203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.843655 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3609a9d4fe144b68a62ad4696301244'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:44.844346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3609a9d4fe144b68a62ad4696301244'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:44.879960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1113/2204] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:44 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:44.879960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.880735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:44.893297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb808e6d-001f-4310-bbdd-46e8c768e89a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:44.898023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:44.898843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:44.899123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:44.899398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] PATH_INFO: `/v3/users/f57fcd1c00b843668da8c67340003681` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:44.900618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57fcd1c00b843668da8c67340003681)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:44.902560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:44.956840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3609a9d4fe144b68a62ad4696301244'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:44.968599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3609a9d4fe144b68a62ad4696301244'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:44.969229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3609a9d4fe144b68a62ad4696301244'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:44.982880 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1092/2205] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:44 2022] DELETE /identity/v3/users/e3609a9d4fe144b68a62ad4696301244 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:44.984094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:44.985397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.055454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c8cd3-586a-4af0-aebb-ef8cc17ffd13 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.060845 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.061636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.061922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.062202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.063083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.064870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.077831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1093/2206] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:45.081424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.082456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57fcd1c00b843668da8c67340003681'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.083354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57fcd1c00b843668da8c67340003681'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.093559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75514c-1dc9-4248-91da-0f1c87ac980f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.097637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57fcd1c00b843668da8c67340003681'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.101227 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.102034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.102380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.102720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] PATH_INFO: `/v3/projects/773f1c111a1a40309e41c4ca92df9f17/users/3c5ca3cc728d456ba86a005cf208000b/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.118303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773f1c111a1a40309e41c4ca92df9f17, user_id=3c5ca3cc728d456ba86a005cf208000b, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.121704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.202545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57fcd1c00b843668da8c67340003681'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.203597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-197784f8-080d-42cc-8ebe-cc481204b33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57fcd1c00b843668da8c67340003681'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.209532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1094/2207] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:45 2022] PUT /identity/v3/projects/773f1c111a1a40309e41c4ca92df9f17/users/3c5ca3cc728d456ba86a005cf208000b/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:45.213977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.215728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.220009 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1114/2208] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:44 2022] DELETE /identity/v3/users/f57fcd1c00b843668da8c67340003681 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:45.224371 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.224673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.225162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.247860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:45.249328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.295560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f854-417e-4465-a440-4db61d804f53 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.313526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1115/2209] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:45.314662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.315974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.335289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9676a-c8ef-49e3-96cc-e21d038d8eff None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.340965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.341928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.342242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.342522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] PATH_INFO: `/v3/projects/fece42b3279f4d4aac21d7922c52c5ed` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.344338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fece42b3279f4d4aac21d7922c52c5ed)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.346281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.347725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.348541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.349039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.349210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.353388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.353388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.362775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1095/2210] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:45.363818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.365872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.422318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b04af5-e297-4dfa-9dc9-5861d11ae8b8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.426087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.426727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.427010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.427287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.436749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.438205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.447745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1096/2211] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:45.448536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.457932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6815-eaf7-432d-95fd-d496cd3b2a16 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.467743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c5a03-3a13-4df5-aa18-4dfa28e163fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.467743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c5a03-3a13-4df5-aa18-4dfa28e163fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.467743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c5a03-3a13-4df5-aa18-4dfa28e163fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.467743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c5a03-3a13-4df5-aa18-4dfa28e163fe admin admin] PATH_INFO: `/v3/projects/773f1c111a1a40309e41c4ca92df9f17/users/3c5ca3cc728d456ba86a005cf208000b/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.468115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c5a03-3a13-4df5-aa18-4dfa28e163fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=773f1c111a1a40309e41c4ca92df9f17, user_id=3c5ca3cc728d456ba86a005cf208000b, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.469911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c5a03-3a13-4df5-aa18-4dfa28e163fe admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.481740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1097/2212] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:45 2022] PUT /identity/v3/projects/773f1c111a1a40309e41c4ca92df9f17/users/3c5ca3cc728d456ba86a005cf208000b/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:45.491419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.491815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.492167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.502967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fece42b3279f4d4aac21d7922c52c5ed', 'request_id': 'req-b4988fde-c7d3-42f5-affe-887e8e9355ea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.519692 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] MFA Rules not processed for user `3c5ca3cc728d456ba86a005cf208000b`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:45.520917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.579321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fece42b3279f4d4aac21d7922c52c5ed', 'request_id': 'req-b4988fde-c7d3-42f5-affe-887e8e9355ea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.589354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fece42b3279f4d4aac21d7922c52c5ed', 'request_id': 'req-b4988fde-c7d3-42f5-affe-887e8e9355ea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.589501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1098/2213] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:45.596973 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] The token cache is being invalidate because project fece42b3279f4d4aac21d7922c52c5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:45.597388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.597522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.598229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b4988fde-c7d3-42f5-affe-887e8e9355ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:45.598889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.599886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1116/2214] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:45 2022] DELETE /identity/v3/projects/fece42b3279f4d4aac21d7922c52c5ed => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:45.605890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70da72-2112-48b6-9c6e-2151c1ed6872 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.606517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70da72-2112-48b6-9c6e-2151c1ed6872 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.606859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70da72-2112-48b6-9c6e-2151c1ed6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.626338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-9d70da72-2112-48b6-9c6e-2151c1ed6872 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:45.627583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9d70da72-2112-48b6-9c6e-2151c1ed6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.670321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cfeb3-0396-4dfb-8210-689a4aecd3b9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.675038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.675812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.676167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.676512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.682507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.696225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.698381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.702583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1117/2215] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:45.707938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1099/2216] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:45.710251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885468bf-4978-42e5-bd6b-52a6fb6f1f38 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.710530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885468bf-4978-42e5-bd6b-52a6fb6f1f38 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.710811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885468bf-4978-42e5-bd6b-52a6fb6f1f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.734494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-885468bf-4978-42e5-bd6b-52a6fb6f1f38 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:45.735698 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-885468bf-4978-42e5-bd6b-52a6fb6f1f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.738785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.740331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.745929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1118/2217] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:45.749605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885468bf-4978-42e5-bd6b-52a6fb6f1f38 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.753848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066bef-b85b-48e3-a7ea-6e7f90c07481 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.760035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885468bf-4978-42e5-bd6b-52a6fb6f1f38 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.761640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.761640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.761869 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.762210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] PATH_INFO: `/v3/users/47ffad66a655413e9fa1466badd27b6f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.763478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ffad66a655413e9fa1466badd27b6f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.765416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.765780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.766508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.767014 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.767363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.768313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:45.768652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.770270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.783132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1119/2218] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:22:45.787382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.797364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c7d18-7754-448c-970a-e4ce90d7d89a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.802031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.802669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.802957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.803235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.803935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.805869 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:45.922353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1120/2219] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:45 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:45.925358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:45.925358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:45.985702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce8f0-bcb5-410a-a788-a72d486f749a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:45.990533 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:45.991370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:45.991674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:45.991950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] PATH_INFO: `/v3/projects/72e7468a4b7249c9be4d89b2e7c10e7b` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:45.993183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e7468a4b7249c9be4d89b2e7c10e7b)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:45.995633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.015033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ffad66a655413e9fa1466badd27b6f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.017014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ffad66a655413e9fa1466badd27b6f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.103982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ffad66a655413e9fa1466badd27b6f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.108606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e7468a4b7249c9be4d89b2e7c10e7b', 'request_id': 'req-8431a8b8-6816-4b22-a894-4fe0e1a091c8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.116671 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ffad66a655413e9fa1466badd27b6f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.117359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ffad66a655413e9fa1466badd27b6f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.128982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1100/2220] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:45 2022] DELETE /identity/v3/users/47ffad66a655413e9fa1466badd27b6f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:46.131678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.131924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.183910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e7468a4b7249c9be4d89b2e7c10e7b', 'request_id': 'req-8431a8b8-6816-4b22-a894-4fe0e1a091c8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.193808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e7468a4b7249c9be4d89b2e7c10e7b', 'request_id': 'req-8431a8b8-6816-4b22-a894-4fe0e1a091c8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.200356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755dc91-25f0-49f8-9b7f-220fafa20fc4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.205628 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.205795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] The token cache is being invalidate because project 72e7468a4b7249c9be4d89b2e7c10e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:46.206071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.206296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.206586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.206861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8431a8b8-6816-4b22-a894-4fe0e1a091c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.206981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.207568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.208705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1121/2221] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:45 2022] DELETE /identity/v3/projects/72e7468a4b7249c9be4d89b2e7c10e7b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:46.211959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.212352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.212352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.212352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.229961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:46.230609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.246749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1122/2222] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:46.254637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.254637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.265017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496fb29-c761-42f5-85c2-e787dedb6848 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.269653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.270491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.270768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.271036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] PATH_INFO: `/v3/users/c5683c5566f2405289b747372fa7d688` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.272233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5683c5566f2405289b747372fa7d688)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.274207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.315229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1101/2223] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:46 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:46.315899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.317530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.372466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a6acd-76af-467d-97c4-aaec15103640 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.376163 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.376789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.377074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.377379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.387075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.388648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.398439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1102/2224] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:46.399054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.400886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.413305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77724e19-dbef-4e8f-8639-187b6257e5c3 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.418168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.418810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.419097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.419377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.420108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.421938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.432418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1103/2225] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:46.436611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.448077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f004ee-9d89-498c-baf2-e48bea69e62b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.454266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.461410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.461410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.461410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.461410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.461410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.472201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1104/2226] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:46.473318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.483345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9df2a-7b69-43e9-ab83-d2ae47634f18 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.490089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924063c-18cd-4277-a6f4-a3c7ca42794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.490089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924063c-18cd-4277-a6f4-a3c7ca42794d admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.490406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924063c-18cd-4277-a6f4-a3c7ca42794d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.490406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924063c-18cd-4277-a6f4-a3c7ca42794d admin admin] PATH_INFO: `/v3/projects/040681342f4d4a72b3e77bc6e8da53de/users/daadc53286e44b338508172be1bc8a5e/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.502094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5683c5566f2405289b747372fa7d688'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.502854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5683c5566f2405289b747372fa7d688'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.506044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924063c-18cd-4277-a6f4-a3c7ca42794d admin admin] RBAC: Authorizing `identity:create_grant(project_id=040681342f4d4a72b3e77bc6e8da53de, user_id=daadc53286e44b338508172be1bc8a5e, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.508757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924063c-18cd-4277-a6f4-a3c7ca42794d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.514909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5683c5566f2405289b747372fa7d688'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.631141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5683c5566f2405289b747372fa7d688'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.631931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5683c5566f2405289b747372fa7d688'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:46.638214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1105/2227] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:46 2022] PUT /identity/v3/projects/040681342f4d4a72b3e77bc6e8da53de/users/daadc53286e44b338508172be1bc8a5e/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:46.647398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1123/2228] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:46 2022] DELETE /identity/v3/users/c5683c5566f2405289b747372fa7d688 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:46.653196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.653508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.653786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.680372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] MFA Rules not processed for user `daadc53286e44b338508172be1bc8a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:46.682119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.746432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1106/2229] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:46.751217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.752867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.822411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a6b5f-bb38-4b80-a239-8f9e5e7623dd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.827327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.829214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.829214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.829214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.829514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.831243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.918907 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:46.925339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:46.936190 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880b1b-acbd-4402-aa02-0a8dd97d0ae7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:46.940901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:46.941773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:46.942195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:46.942473 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] PATH_INFO: `/v3/projects/42415143b27b48c184428109a9d2f3be` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:46.953347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42415143b27b48c184428109a9d2f3be)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:46.953347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:46.954939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1124/2230] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:46 2022] POST /identity/v3/projects => generated 401 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:46.959235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.030507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b979d7c-0a18-4713-b507-6dcef874d34a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.035864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.036598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.036923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.037232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.044570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.044570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.140107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42415143b27b48c184428109a9d2f3be', 'request_id': 'req-628a0802-7624-4bcd-b6f4-2a2af3aadde8'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.182019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1125/2231] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:46 2022] POST /identity/v3/users => generated 307 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:47.182019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.191278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5992d-e6bf-486d-94d5-8cca978a179a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.249429 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.250227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.250503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.250656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.251570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.253140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.263688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1126/2232] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:47.264479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.266114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.268813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42415143b27b48c184428109a9d2f3be', 'request_id': 'req-628a0802-7624-4bcd-b6f4-2a2af3aadde8'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.275887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42415143b27b48c184428109a9d2f3be', 'request_id': 'req-628a0802-7624-4bcd-b6f4-2a2af3aadde8'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.278717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f53a1-ed97-43da-abb4-8d5dd60170dd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.283589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.284329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.284782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.285072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] PATH_INFO: `/v3/projects/793e50837cb742c6bd15e0d8bf011c10` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.286583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793e50837cb742c6bd15e0d8bf011c10)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.286687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] The token cache is being invalidate because project 42415143b27b48c184428109a9d2f3be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:47.286895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.287555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.288194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.289141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1107/2233] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:46 2022] DELETE /identity/v3/projects/42415143b27b48c184428109a9d2f3be => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:47.290065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.291372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.303911 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0802-7624-4bcd-b6f4-2a2af3aadde8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.309095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.309995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.310277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.310552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] PATH_INFO: `/v3/projects/c46b950916b64e23bf95acc24650eeff/users/5c42460c113244dbbafea6a74af1ead9/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.326589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46b950916b64e23bf95acc24650eeff, user_id=5c42460c113244dbbafea6a74af1ead9, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.329226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.455166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1108/2234] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:47 2022] PUT /identity/v3/projects/c46b950916b64e23bf95acc24650eeff/users/5c42460c113244dbbafea6a74af1ead9/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:47.456095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.457682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.464785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793e50837cb742c6bd15e0d8bf011c10', 'request_id': 'req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.521202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1579e5-491c-446c-91ef-ee726d0927cb admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.557255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793e50837cb742c6bd15e0d8bf011c10', 'request_id': 'req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.563576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793e50837cb742c6bd15e0d8bf011c10', 'request_id': 'req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.575351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.575579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] The token cache is being invalidate because project 793e50837cb742c6bd15e0d8bf011c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:47.575897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.576208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.576478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.576747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] PATH_INFO: `/v3/users/3c5ca3cc728d456ba86a005cf208000b` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.576889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.578048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5ca3cc728d456ba86a005cf208000b)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.579146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1127/2235] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:47 2022] DELETE /identity/v3/projects/793e50837cb742c6bd15e0d8bf011c10 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:47.581657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.581786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.582650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.596559 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a8b8-5ce8-42c2-b00b-35ec899641a3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.601618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f696c-bfbe-472b-89fb-f42f3d9cd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.602276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f696c-bfbe-472b-89fb-f42f3d9cd170 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.602568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f696c-bfbe-472b-89fb-f42f3d9cd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.602868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f696c-bfbe-472b-89fb-f42f3d9cd170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.603614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f696c-bfbe-472b-89fb-f42f3d9cd170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.605455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f696c-bfbe-472b-89fb-f42f3d9cd170 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.616239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1128/2236] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:47.617635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6b6b-4c00-46d1-a042-8ac3de87ae5f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.617924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6b6b-4c00-46d1-a042-8ac3de87ae5f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.618253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6b6b-4c00-46d1-a042-8ac3de87ae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.636486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4e8c6b6b-4c00-46d1-a042-8ac3de87ae5f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:47.637704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4e8c6b6b-4c00-46d1-a042-8ac3de87ae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.645574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1129/2237] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:47.646523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c6b6b-4c00-46d1-a042-8ac3de87ae5f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.655957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c6b6b-4c00-46d1-a042-8ac3de87ae5f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.660983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88f8a2-787e-4707-8be8-31669a6f984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.661628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88f8a2-787e-4707-8be8-31669a6f984e admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.661830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88f8a2-787e-4707-8be8-31669a6f984e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.662108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88f8a2-787e-4707-8be8-31669a6f984e admin admin] PATH_INFO: `/v3/projects/c46b950916b64e23bf95acc24650eeff/users/5c42460c113244dbbafea6a74af1ead9/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.664620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88f8a2-787e-4707-8be8-31669a6f984e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46b950916b64e23bf95acc24650eeff, user_id=5c42460c113244dbbafea6a74af1ead9, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.667299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88f8a2-787e-4707-8be8-31669a6f984e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.677808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1130/2238] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:47 2022] PUT /identity/v3/projects/c46b950916b64e23bf95acc24650eeff/users/5c42460c113244dbbafea6a74af1ead9/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:47.679168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90be1-d88e-4fad-b9f4-44988ad53fc7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.679526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90be1-d88e-4fad-b9f4-44988ad53fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.679868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c90be1-d88e-4fad-b9f4-44988ad53fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.698557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-51c90be1-d88e-4fad-b9f4-44988ad53fc7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:47.699741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-51c90be1-d88e-4fad-b9f4-44988ad53fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.756612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1131/2239] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:47.757975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe7bb4-d0ad-40f1-937e-6a590ee4a956 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.758263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe7bb4-d0ad-40f1-937e-6a590ee4a956 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.758541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe7bb4-d0ad-40f1-937e-6a590ee4a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.784356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e0fe7bb4-d0ad-40f1-937e-6a590ee4a956 None None] MFA Rules not processed for user `5c42460c113244dbbafea6a74af1ead9`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:47.785579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e0fe7bb4-d0ad-40f1-937e-6a590ee4a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.810015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5ca3cc728d456ba86a005cf208000b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.810680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5ca3cc728d456ba86a005cf208000b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.859061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1132/2240] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:47.859910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe7bb4-d0ad-40f1-937e-6a590ee4a956 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.869427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe7bb4-d0ad-40f1-937e-6a590ee4a956 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.874080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.874718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.875000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.875277 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.876008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:47.876316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.877976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.890002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1133/2241] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:22:47.890858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.892493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.939447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5ca3cc728d456ba86a005cf208000b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.945882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3405dad-8118-49b8-a259-e2d66913225c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:47.950479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:47.951113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:47.951397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:47.951672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:47.953043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5ca3cc728d456ba86a005cf208000b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.953731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5ca3cc728d456ba86a005cf208000b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:47.960949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:47.962489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:47.965917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1109/2242] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:47 2022] DELETE /identity/v3/users/3c5ca3cc728d456ba86a005cf208000b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:47.966398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:47.967747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:47.972310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1134/2243] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:48.036001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be79c7b-1635-4ec7-8575-74e247f71070 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.041668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.042589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.042981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.043358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.044271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.046526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.160018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1110/2244] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:47 2022] POST /identity/v3/projects => generated 391 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:48.164552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.175417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35691f-1005-4dd2-a71e-43c9e748d5c0 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.243651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.244325 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.244750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.245035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.245829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.247746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.274293 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.276589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:48.332965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab63e-3173-484c-9b33-1ff412abbcc2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.336675 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.337856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.338139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.338409 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.338624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1135/2245] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:48.340411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:48.342602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.351968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc1d9-6a38-4d34-b131-d7d81f5f6888 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.357137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.357820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.358111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.358385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.359117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.360694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.371308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1136/2246] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:48.375279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.385519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02a3a5-78e2-4d5f-a8ee-347cec7ab949 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.390518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.391163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.397404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.397404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.397404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.397404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.399904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.401426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.404818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1137/2247] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:48.408937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.410991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1111/2248] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:48.420903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d841ef-63aa-431f-98c9-385c38659bc9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.426260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.427336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:48.429134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be4d0b-658f-428a-be6e-e93fba1d1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.438661 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4d0b-658f-428a-be6e-e93fba1d1807 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.439027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4d0b-658f-428a-be6e-e93fba1d1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.439379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4d0b-658f-428a-be6e-e93fba1d1807 admin admin] PATH_INFO: `/v3/projects/08cefd8245534f1a91252530f90b017e/users/7b6390844fe548019ed76655ce56deca/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.444371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1c90-d1cf-43f7-a285-bcb1dce2def8 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.450472 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.451676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.452045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.452221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] PATH_INFO: `/v3/projects/773f1c111a1a40309e41c4ca92df9f17` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.453770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773f1c111a1a40309e41c4ca92df9f17)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.456226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.457254 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be4d0b-658f-428a-be6e-e93fba1d1807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cefd8245534f1a91252530f90b017e, user_id=7b6390844fe548019ed76655ce56deca, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.460070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be4d0b-658f-428a-be6e-e93fba1d1807 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.549675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1138/2249] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:48 2022] PUT /identity/v3/projects/08cefd8245534f1a91252530f90b017e/users/7b6390844fe548019ed76655ce56deca/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:48.560228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf492-98b7-4f04-ab5a-25b70674df73 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.560516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf492-98b7-4f04-ab5a-25b70674df73 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.560896 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bf492-98b7-4f04-ab5a-25b70674df73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.579145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773f1c111a1a40309e41c4ca92df9f17', 'request_id': 'req-2c731f2a-8039-4ae2-9384-3039fdc8ec60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:48.585891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b65bf492-98b7-4f04-ab5a-25b70674df73 None None] MFA Rules not processed for user `7b6390844fe548019ed76655ce56deca`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:48.587104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b65bf492-98b7-4f04-ab5a-25b70674df73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:48.648712 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1139/2250] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:48.653055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bf492-98b7-4f04-ab5a-25b70674df73 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.688166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773f1c111a1a40309e41c4ca92df9f17', 'request_id': 'req-2c731f2a-8039-4ae2-9384-3039fdc8ec60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:48.694928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773f1c111a1a40309e41c4ca92df9f17', 'request_id': 'req-2c731f2a-8039-4ae2-9384-3039fdc8ec60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:48.706776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] The token cache is being invalidate because project 773f1c111a1a40309e41c4ca92df9f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:48.707558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:48.708373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2c731f2a-8039-4ae2-9384-3039fdc8ec60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:48.710336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1112/2251] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:48 2022] DELETE /identity/v3/projects/773f1c111a1a40309e41c4ca92df9f17 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:48.715354 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9613d-8d5c-4d6c-b00e-1f612808a017 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.715538 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bf492-98b7-4f04-ab5a-25b70674df73 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.715976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9613d-8d5c-4d6c-b00e-1f612808a017 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.716259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9613d-8d5c-4d6c-b00e-1f612808a017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.720152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.720805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.721094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.721527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.722176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.724092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.735703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bec9613d-8d5c-4d6c-b00e-1f612808a017 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:48.736907 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bec9613d-8d5c-4d6c-b00e-1f612808a017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:48.745584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1113/2252] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:48.753949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef361c8-b644-4bf1-b27e-6a159d6a3915 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.754237 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef361c8-b644-4bf1-b27e-6a159d6a3915 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.754513 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef361c8-b644-4bf1-b27e-6a159d6a3915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.772245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-eef361c8-b644-4bf1-b27e-6a159d6a3915 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:48.773476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-eef361c8-b644-4bf1-b27e-6a159d6a3915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:48.781812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1114/2253] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:48.785786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef361c8-b644-4bf1-b27e-6a159d6a3915 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.795059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef361c8-b644-4bf1-b27e-6a159d6a3915 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.799747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.800306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.800587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.800861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.801620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:48.801924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.803502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.814929 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1115/2254] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:22:48.819199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.828747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea8c01-cd53-4e11-a101-9a157095ad75 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.833235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.833868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.834147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.834417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.835147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.836957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.855909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1140/2255] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:48.860131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.861705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:48.922723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a7b70-6066-4f04-ad8f-eedb2a66ef99 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.930787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1116/2256] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:48.931415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.931415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.931415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.931415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.931888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.932196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:48.932305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:48.989378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633686c-5603-443a-a085-22c093993e2a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:48.994586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:48.995244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:48.995558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:48.995836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:48.996589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:48.998605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.034953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1141/2257] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/users => generated 303 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:49.038817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.048207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d3fa-684c-40dc-8b49-0ff2735e39c0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.056952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.056952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.056952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.056952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.057372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.057372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.066316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1142/2258] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:49.070054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.079747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f9082-ff39-47c6-b7bb-bf707d326538 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.084369 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.085181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.085490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.086644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] PATH_INFO: `/v3/projects/1fa77643174a46a9806973ff8940ba5c/users/58dd83bc01f243e2b0d6040c578e4222/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.100451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa77643174a46a9806973ff8940ba5c, user_id=58dd83bc01f243e2b0d6040c578e4222, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.103253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.116815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1117/2259] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:48 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:49.121114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.135502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388a7fe-2df8-4a6f-a471-6d0163593c0e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.140557 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.141309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.141665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.142012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.142862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.144527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.157830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1118/2260] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:49.158910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.169212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0693a-de17-4d09-a652-8131f2f0ca2d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.174183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.174824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.175105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.175381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.176161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.177798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.190045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1119/2261] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:49.193928 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.204425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1143/2262] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:49 2022] PUT /identity/v3/projects/1fa77643174a46a9806973ff8940ba5c/users/58dd83bc01f243e2b0d6040c578e4222/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:49.204662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ffe0-fb26-4129-900e-92accd138c28 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.213767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.270978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48e8cf-b837-43fd-89a8-fcc8435ab16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.271876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e8cf-b837-43fd-89a8-fcc8435ab16e admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.272154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e8cf-b837-43fd-89a8-fcc8435ab16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.272425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e8cf-b837-43fd-89a8-fcc8435ab16e admin admin] PATH_INFO: `/v3/projects/bf46e8925ac9433593c2eb444f1c2cfc/users/ca3a8e3fc70f4527bc1c524ab4d939e9/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.291349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48e8cf-b837-43fd-89a8-fcc8435ab16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf46e8925ac9433593c2eb444f1c2cfc, user_id=ca3a8e3fc70f4527bc1c524ab4d939e9, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.294300 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48e8cf-b837-43fd-89a8-fcc8435ab16e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.303308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22606a-b562-4992-b1fa-a446fafd71d6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.309229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.309917 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.310494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.310774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.311522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.313101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.326866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1144/2263] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:49.327887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.338056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f279b-0823-4f8d-8791-73c6c396bc3f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.342846 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac426dc8-f062-43de-9a67-22ae5b596017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.343717 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac426dc8-f062-43de-9a67-22ae5b596017 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.343996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac426dc8-f062-43de-9a67-22ae5b596017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.344271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac426dc8-f062-43de-9a67-22ae5b596017 admin admin] PATH_INFO: `/v3/projects/1fa77643174a46a9806973ff8940ba5c/users/58dd83bc01f243e2b0d6040c578e4222/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.346334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac426dc8-f062-43de-9a67-22ae5b596017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa77643174a46a9806973ff8940ba5c, user_id=58dd83bc01f243e2b0d6040c578e4222, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.348979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac426dc8-f062-43de-9a67-22ae5b596017 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.360660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1145/2264] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:49 2022] PUT /identity/v3/projects/1fa77643174a46a9806973ff8940ba5c/users/58dd83bc01f243e2b0d6040c578e4222/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:49.368072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1120/2265] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:49 2022] PUT /identity/v3/projects/bf46e8925ac9433593c2eb444f1c2cfc/users/ca3a8e3fc70f4527bc1c524ab4d939e9/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:49.373270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc620-7ac4-4b26-b63b-9dcd4280269c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.373658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc620-7ac4-4b26-b63b-9dcd4280269c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.374008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fc620-7ac4-4b26-b63b-9dcd4280269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.378878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.379314 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.379421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.402809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-914fc620-7ac4-4b26-b63b-9dcd4280269c None None] MFA Rules not processed for user `58dd83bc01f243e2b0d6040c578e4222`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:49.404089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-914fc620-7ac4-4b26-b63b-9dcd4280269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:49.410205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] MFA Rules not processed for user `ca3a8e3fc70f4527bc1c524ab4d939e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:49.411542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:49.473116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1146/2266] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:49.476280 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1121/2267] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:49.480811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fc620-7ac4-4b26-b63b-9dcd4280269c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.484223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.485687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:49.541877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136fd8-abac-4633-a25e-838e247bee94 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.544149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fc620-7ac4-4b26-b63b-9dcd4280269c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.545596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.546235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.546516 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.546793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.548919 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.549628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.549879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.550164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.550867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.554675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.556146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.557612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.567209 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1122/2268] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:49.615935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.617410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:49.631267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd2809-3dff-41e1-98b9-673cf850f424 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.633210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1147/2269] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:49 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:49.638328 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.687370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.688010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.688306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.688562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.690402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:49.724401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73047e27-4dfa-4160-8cc7-b2a9693e8c25 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.729698 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.730358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.730636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.730906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.731903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.733835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.755198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.756644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.765815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1123/2270] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:49.820783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1148/2271] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:49 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:49.824888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.836789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5104d1-fba8-4588-b01c-69bf7f01eb0c service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.845618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.846284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.847184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.847458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.848256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.850555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.862694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1124/2272] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:49.867058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:49.877612 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec1229-c64d-4c70-9dd2-b1b3d6a51511 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:49.882416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:49.886712 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:49.886712 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:49.886712 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] PATH_INFO: `/v3/projects/86776092ddb34825ab6a00fed952b9a3/users/c2bb3f94a5da445c88960cc8c2897b33/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:49.902967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86776092ddb34825ab6a00fed952b9a3, user_id=c2bb3f94a5da445c88960cc8c2897b33, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:49.906046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:49.997451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1149/2273] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:49 2022] PUT /identity/v3/projects/86776092ddb34825ab6a00fed952b9a3/users/c2bb3f94a5da445c88960cc8c2897b33/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:50.001576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:50.011852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34a370-cef6-48a9-adf0-2e08e1d6b167 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:50.069266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acdefb-1417-4dd7-a8f8-689c93e10e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:50.069977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acdefb-1417-4dd7-a8f8-689c93e10e78 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:50.070260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acdefb-1417-4dd7-a8f8-689c93e10e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:50.070537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acdefb-1417-4dd7-a8f8-689c93e10e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:50.071351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acdefb-1417-4dd7-a8f8-689c93e10e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:50.073514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acdefb-1417-4dd7-a8f8-689c93e10e78 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:50.083111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1125/2274] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:50.087970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:50.098287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0756-7b10-467b-9717-e9dbb57e848b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:50.103035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:50.103935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:50.104217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:50.104488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] PATH_INFO: `/v3/projects/86776092ddb34825ab6a00fed952b9a3/users/c2bb3f94a5da445c88960cc8c2897b33/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:50.106761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86776092ddb34825ab6a00fed952b9a3, user_id=c2bb3f94a5da445c88960cc8c2897b33, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:50.109475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:50.128319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1150/2275] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:50 2022] PUT /identity/v3/projects/86776092ddb34825ab6a00fed952b9a3/users/c2bb3f94a5da445c88960cc8c2897b33/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:50.142302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d793bf-1d19-4aa8-9120-d97e7114c1af None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:50.142597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d793bf-1d19-4aa8-9120-d97e7114c1af None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:50.142849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d793bf-1d19-4aa8-9120-d97e7114c1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:50.175983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-90d793bf-1d19-4aa8-9120-d97e7114c1af None None] MFA Rules not processed for user `c2bb3f94a5da445c88960cc8c2897b33`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:50.177189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-90d793bf-1d19-4aa8-9120-d97e7114c1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:50.247396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1126/2276] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:50.269482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:50.332576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d6e4-ec2e-4752-8587-ccd514727958 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:50.336201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:50.336841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:50.337659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:50.337962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:50.347263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:50.348715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:50.359000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1151/2277] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:50.742210 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d793bf-1d19-4aa8-9120-d97e7114c1af None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:50.752060 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d793bf-1d19-4aa8-9120-d97e7114c1af None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:50.755644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eed90-6b42-4eda-83bb-328998d8338b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:50.756272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eed90-6b42-4eda-83bb-328998d8338b service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:50.756551 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eed90-6b42-4eda-83bb-328998d8338b service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:50.756825 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eed90-6b42-4eda-83bb-328998d8338b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:50.813041 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eed90-6b42-4eda-83bb-328998d8338b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:50.814522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eed90-6b42-4eda-83bb-328998d8338b service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:50.823525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1127/2278] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:51.465462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:51.526806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673dab8-a323-4d0e-9c98-c509860ac6ef service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:51.531262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:51.532108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:51.532387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:51.532655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] PATH_INFO: `/v3/users/ca3a8e3fc70f4527bc1c524ab4d939e9` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:51.533939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3a8e3fc70f4527bc1c524ab4d939e9)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:51.535818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:51.882555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3a8e3fc70f4527bc1c524ab4d939e9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:51.883214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3a8e3fc70f4527bc1c524ab4d939e9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:51.895149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3a8e3fc70f4527bc1c524ab4d939e9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:51.979175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3a8e3fc70f4527bc1c524ab4d939e9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:51.979798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3a8e3fc70f4527bc1c524ab4d939e9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:51.992986 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1152/2279] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:51 2022] DELETE /identity/v3/users/ca3a8e3fc70f4527bc1c524ab4d939e9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:51.997979 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:51.998479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:51.998585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:52.016645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:52.017541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:52.079391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1128/2280] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:52.089224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:52.090653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:52.149493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b07b69-5064-42e9-84db-990f58a78785 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:52.153194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:52.158440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:52.158440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:52.158440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:52.165804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:52.167304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:52.177256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1153/2281] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:52.610680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:52.612978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:52.625131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf059-91e3-475c-a5f4-99e06c7a161b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:52.641562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c619-3740-4037-9515-551397c304ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:52.642378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c619-3740-4037-9515-551397c304ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:52.642647 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c619-3740-4037-9515-551397c304ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:52.642950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c619-3740-4037-9515-551397c304ef admin admin] PATH_INFO: `/v3/projects/bf46e8925ac9433593c2eb444f1c2cfc` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:52.644095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c619-3740-4037-9515-551397c304ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf46e8925ac9433593c2eb444f1c2cfc)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:52.646092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c619-3740-4037-9515-551397c304ef admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:52.785775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf46e8925ac9433593c2eb444f1c2cfc', 'request_id': 'req-7583c619-3740-4037-9515-551397c304ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:52.848164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf46e8925ac9433593c2eb444f1c2cfc', 'request_id': 'req-7583c619-3740-4037-9515-551397c304ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:52.855542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf46e8925ac9433593c2eb444f1c2cfc', 'request_id': 'req-7583c619-3740-4037-9515-551397c304ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:52.866194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7583c619-3740-4037-9515-551397c304ef admin admin] The token cache is being invalidate because project bf46e8925ac9433593c2eb444f1c2cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:52.866482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:52.867136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:52.868905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1129/2282] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:52 2022] DELETE /identity/v3/projects/bf46e8925ac9433593c2eb444f1c2cfc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:52.872788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:52.883234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a26d2-4ce8-4306-adfd-08a6fac8267c service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:52.941372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:52.942334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:52.942621 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:52.942890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] PATH_INFO: `/v3/users/c2bb3f94a5da445c88960cc8c2897b33` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:52.944116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bb3f94a5da445c88960cc8c2897b33)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:52.946104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:53.153613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bb3f94a5da445c88960cc8c2897b33'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.154498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bb3f94a5da445c88960cc8c2897b33'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.166990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bb3f94a5da445c88960cc8c2897b33'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.259233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bb3f94a5da445c88960cc8c2897b33'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.259872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-24f673ff-85d1-4a45-be43-58b6b5572ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bb3f94a5da445c88960cc8c2897b33'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.272143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1154/2283] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:52 2022] DELETE /identity/v3/users/c2bb3f94a5da445c88960cc8c2897b33 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:53.654554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:53.656086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:53.668913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c619-3740-4037-9515-551397c304ef admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:53.730688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:53.731793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:53.732067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:53.732335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] PATH_INFO: `/v3/projects/86776092ddb34825ab6a00fed952b9a3` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:53.733570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=86776092ddb34825ab6a00fed952b9a3)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:53.735457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:53.876106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86776092ddb34825ab6a00fed952b9a3', 'request_id': 'req-8155a178-6787-474b-81fc-4c4d69f66b5a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.967888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86776092ddb34825ab6a00fed952b9a3', 'request_id': 'req-8155a178-6787-474b-81fc-4c4d69f66b5a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.974753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86776092ddb34825ab6a00fed952b9a3', 'request_id': 'req-8155a178-6787-474b-81fc-4c4d69f66b5a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.985618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] The token cache is being invalidate because project 86776092ddb34825ab6a00fed952b9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:53.985908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.986561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:53.988098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1130/2284] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:53 2022] DELETE /identity/v3/projects/86776092ddb34825ab6a00fed952b9a3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:53.993256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7331b-96b1-4fed-9510-2ced54ed9bf5 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:53.994303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7331b-96b1-4fed-9510-2ced54ed9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:53.994585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7331b-96b1-4fed-9510-2ced54ed9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.011897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.013521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:54.014626 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2ab7331b-96b1-4fed-9510-2ced54ed9bf5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:54.015797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2ab7331b-96b1-4fed-9510-2ced54ed9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:54.080440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a178-6787-474b-81fc-4c4d69f66b5a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.084267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1155/2285] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:54.093313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.093496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8a57-d66d-4030-95af-7a5a95a55032 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.093728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8a57-d66d-4030-95af-7a5a95a55032 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.094012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8a57-d66d-4030-95af-7a5a95a55032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.094464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.095500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.095500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] PATH_INFO: `/v3/users/daadc53286e44b338508172be1bc8a5e` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.096528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daadc53286e44b338508172be1bc8a5e)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.098749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.114554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1feb8a57-d66d-4030-95af-7a5a95a55032 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:54.116102 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1feb8a57-d66d-4030-95af-7a5a95a55032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:54.125198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1156/2286] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:54.128956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb8a57-d66d-4030-95af-7a5a95a55032 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.137862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb8a57-d66d-4030-95af-7a5a95a55032 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.142741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.143532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.143879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.144225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.144960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:54.145270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.146854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.159215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1157/2287] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:22:54.163250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.173194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930206-29d3-4fcb-be76-ccdd053ec900 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.177848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.178459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.178741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.179017 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.179703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.181600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.301365 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1158/2288] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:54 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:54.305571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.330106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daadc53286e44b338508172be1bc8a5e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:54.330908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daadc53286e44b338508172be1bc8a5e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:54.364487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b55d17-c5e3-4fc9-bec2-ac9e39bffb96 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.369176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.369855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.370135 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.370406 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.371094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.373000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.436595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daadc53286e44b338508172be1bc8a5e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:54.449501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daadc53286e44b338508172be1bc8a5e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:54.450153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-075d0fc9-d616-48e4-9acc-1ba803d30426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daadc53286e44b338508172be1bc8a5e'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:54.461699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1131/2289] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:54 2022] DELETE /identity/v3/users/daadc53286e44b338508172be1bc8a5e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:54.466507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.466781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.467087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.484038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:54.485179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:54.500483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1159/2290] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:54 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:54.507849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.509970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:54.521620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e27c-69be-4e75-ad86-9dcc9fead795 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.547439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1132/2291] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:54.559619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.561010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:54.582360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.583029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.591264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.591264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.591264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.591264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.596745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1160/2292] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:54.600996 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.610921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b0e6-8dc7-4e5b-b0fc-5bc6a6ef045a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.615883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.616549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.616917 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.617115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.617877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.619452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.625693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a416f1-bf5c-485b-8d33-77ef365e3559 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.632303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1161/2293] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:54.632488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365adc6-2f03-42fc-a034-0dcc26bf8284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.632488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365adc6-2f03-42fc-a034-0dcc26bf8284 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.632488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365adc6-2f03-42fc-a034-0dcc26bf8284 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.632488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365adc6-2f03-42fc-a034-0dcc26bf8284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.633329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.641178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365adc6-2f03-42fc-a034-0dcc26bf8284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.642747 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365adc6-2f03-42fc-a034-0dcc26bf8284 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.643504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395a411-4bd4-4113-81c6-0dbdef7566e8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.648222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.649069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.649383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.649705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] PATH_INFO: `/v3/projects/82f946458bc148b3aa3cbef9e59591cf/users/000d6996c2674179874363ecd5a3ce3a/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.652549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1133/2294] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:54.666177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f946458bc148b3aa3cbef9e59591cf, user_id=000d6996c2674179874363ecd5a3ce3a, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.668662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.779580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1162/2295] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:54 2022] PUT /identity/v3/projects/82f946458bc148b3aa3cbef9e59591cf/users/000d6996c2674179874363ecd5a3ce3a/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:54.784834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.785305 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.785431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.802865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:54.804004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:54.871289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1134/2296] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:54.881568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:54.937666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1a304-06e0-42ec-90f3-dde5ed4406b8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:54.952304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:54.952304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:54.952691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:54.952691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:54.962465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:54.964222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:54.974731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1163/2297] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:55.140199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:55.141998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:55.154824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3ffd-2aa2-40c3-818e-ca13b548105a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:55.162411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:55.163500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:55.164027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:55.164507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] PATH_INFO: `/v3/projects/040681342f4d4a72b3e77bc6e8da53de` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:55.166892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040681342f4d4a72b3e77bc6e8da53de)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:55.170281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:55.289955 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040681342f4d4a72b3e77bc6e8da53de', 'request_id': 'req-ef35e85a-aaa1-479b-831a-1a0669f782f6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.406481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040681342f4d4a72b3e77bc6e8da53de', 'request_id': 'req-ef35e85a-aaa1-479b-831a-1a0669f782f6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.413445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040681342f4d4a72b3e77bc6e8da53de', 'request_id': 'req-ef35e85a-aaa1-479b-831a-1a0669f782f6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.427435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] The token cache is being invalidate because project 040681342f4d4a72b3e77bc6e8da53de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:55.427435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.427435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.428913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1135/2298] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:55 2022] DELETE /identity/v3/projects/040681342f4d4a72b3e77bc6e8da53de => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:55.432989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:55.442921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217a9d-de3f-404f-b517-c54569a0ae97 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:55.499700 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:55.504073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:55.504073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:55.504073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] PATH_INFO: `/v3/users/5c42460c113244dbbafea6a74af1ead9` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:55.504073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c42460c113244dbbafea6a74af1ead9)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:55.504379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:55.765156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c42460c113244dbbafea6a74af1ead9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.765904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c42460c113244dbbafea6a74af1ead9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.776830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c42460c113244dbbafea6a74af1ead9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.859619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c42460c113244dbbafea6a74af1ead9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.860281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-950d1841-92f0-44f8-b2b6-e92e74c5f569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c42460c113244dbbafea6a74af1ead9'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:55.873506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1164/2299] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:55 2022] DELETE /identity/v3/users/5c42460c113244dbbafea6a74af1ead9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:56.634595 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:56.635507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:56.657714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35e85a-aaa1-479b-831a-1a0669f782f6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:56.677598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:56.678225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:56.678225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:56.710207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] MFA Rules not processed for user `000d6996c2674179874363ecd5a3ce3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:56.711588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:56.745558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:56.747142 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:56.747431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:56.747707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] PATH_INFO: `/v3/projects/c46b950916b64e23bf95acc24650eeff` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:56.748964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46b950916b64e23bf95acc24650eeff)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:56.750978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:56.781592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1165/2300] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:56.786050 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:56.787373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:56.800417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d952c8-b2c9-471d-84a3-b0d22cae50d8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:56.804977 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:56.805648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:56.805958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:56.806236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:56.806953 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:56.808811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:56.882078 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46b950916b64e23bf95acc24650eeff', 'request_id': 'req-88dc845a-a89b-4253-a952-3675c06a61d9'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:56.901566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1166/2301] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:56 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:56.905673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:56.954965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46b950916b64e23bf95acc24650eeff', 'request_id': 'req-88dc845a-a89b-4253-a952-3675c06a61d9'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:56.961957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46b950916b64e23bf95acc24650eeff', 'request_id': 'req-88dc845a-a89b-4253-a952-3675c06a61d9'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:56.966788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950df5fd-e875-4e51-9308-8db402021bb7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:56.971496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:56.972190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:56.972475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:56.972754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:56.973074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] The token cache is being invalidate because project c46b950916b64e23bf95acc24650eeff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:56.973398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:56.973498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:56.974037 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-88dc845a-a89b-4253-a952-3675c06a61d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:56.975374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:56.975542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1136/2302] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:56 2022] DELETE /identity/v3/projects/c46b950916b64e23bf95acc24650eeff => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:56.976748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586c557-c7b9-44ed-9554-c125ea8f15d8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:56.977040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586c557-c7b9-44ed-9554-c125ea8f15d8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:56.977316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586c557-c7b9-44ed-9554-c125ea8f15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:56.995281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c586c557-c7b9-44ed-9554-c125ea8f15d8 None None] MFA Rules not processed for user `5b5c229e1d0c4da7bc08c068d087a6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:56.996478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c586c557-c7b9-44ed-9554-c125ea8f15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.047843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1137/2303] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:57.049271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030cfeb-c9b7-4070-99a8-336feaf38b3f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.049590 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030cfeb-c9b7-4070-99a8-336feaf38b3f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.049866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030cfeb-c9b7-4070-99a8-336feaf38b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.068111 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2030cfeb-c9b7-4070-99a8-336feaf38b3f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:57.069345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2030cfeb-c9b7-4070-99a8-336feaf38b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.072675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1167/2304] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:56 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:57.076572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.078278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.079445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1138/2305] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:57.086977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ceb8-9df9-4873-962c-caea012be4fb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.087312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ceb8-9df9-4873-962c-caea012be4fb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.092729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641ceb8-9df9-4873-962c-caea012be4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.092849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db713-408b-42f5-b5e1-8b33bb014ba7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.096946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.101886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.102190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.102560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.104010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.105012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.109110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e641ceb8-9df9-4873-962c-caea012be4fb None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:57.110465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e641ceb8-9df9-4873-962c-caea012be4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.121070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1139/2306] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:57.125257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ceb8-9df9-4873-962c-caea012be4fb None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.125756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1168/2307] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:57.129466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.135081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641ceb8-9df9-4873-962c-caea012be4fb None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.140026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.140672 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.140950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.141190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c4c4-9034-470a-8270-7a55224bc96b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.141328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.141973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:22:57.142276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.143897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.146066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.146961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.149432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.149432 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] PATH_INFO: `/v3/projects/8747e6aefc644642a2e24e4993a36726/users/4bcbe4ee1dbf4c15a8f61fcb661452c6/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.156535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1140/2308] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:22:57.160852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.163270 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8747e6aefc644642a2e24e4993a36726, user_id=4bcbe4ee1dbf4c15a8f61fcb661452c6, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.165997 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.171512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9255b5-48d8-4ba7-9f70-01aa118bac40 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.176744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.177412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.177695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.177969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.178697 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.180561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.246891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1169/2309] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:57 2022] PUT /identity/v3/projects/8747e6aefc644642a2e24e4993a36726/users/4bcbe4ee1dbf4c15a8f61fcb661452c6/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:57.247820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.249601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.289987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1141/2310] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:57 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:57.299059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.316728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80902ef9-46cb-434c-a762-b4b2320b6ec7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.364699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff497b-8abf-4e9e-9a0b-30aa5e6ee8b5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.370178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.370912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.371200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.371480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.372223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.373861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.378454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.379416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.379749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.380516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] PATH_INFO: `/v3/users/7b6390844fe548019ed76655ce56deca` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.382056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6390844fe548019ed76655ce56deca)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.384113 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.384740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1142/2311] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:57.385557 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.399575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e517a7f-4482-49d0-b1b8-ca6d7e182bd0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.404299 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.404959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.405244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.405696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.406410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.408322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.503311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1143/2312] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:57 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:57.503311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.509971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448b4f-80a8-45d0-8663-fda5d5652e1e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.514894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.515873 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.516075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.516294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] PATH_INFO: `/v3/projects/8747e6aefc644642a2e24e4993a36726/users/4bcbe4ee1dbf4c15a8f61fcb661452c6/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.518363 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8747e6aefc644642a2e24e4993a36726, user_id=4bcbe4ee1dbf4c15a8f61fcb661452c6, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.524781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.532529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1144/2313] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:57 2022] PUT /identity/v3/projects/8747e6aefc644642a2e24e4993a36726/users/4bcbe4ee1dbf4c15a8f61fcb661452c6/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:57.533378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.566480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6390844fe548019ed76655ce56deca'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:57.567144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6390844fe548019ed76655ce56deca'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:57.579051 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6390844fe548019ed76655ce56deca'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:57.596660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe324c3d-fbee-455f-9e6d-92b4cacc94ec admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.601414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.602065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.602351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.603141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.605159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.607093 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.616919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1145/2314] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:57.621244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.630521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd028-8b70-47bb-9826-bab8daa600f3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.635353 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.636707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.637000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.637301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.638045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.639638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.649701 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1146/2315] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:57.653750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.663181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d385382-14ca-47d9-8a55-1719d0f3eca5 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.669891 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6cbe5-2807-4c10-adf7-3229ae156d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:57.670681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cbe5-2807-4c10-adf7-3229ae156d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.670968 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cbe5-2807-4c10-adf7-3229ae156d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.671246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cbe5-2807-4c10-adf7-3229ae156d46 admin admin] PATH_INFO: `/v3/projects/a680c20d4e14413d98b56ad61e0ddfde/users/58091ec20dda4c7eabc78061658a25c0/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.677495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6390844fe548019ed76655ce56deca'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:57.678218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-31b13c41-2623-43a1-b40b-6ab470989f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6390844fe548019ed76655ce56deca'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:57.698367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1170/2316] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:57 2022] DELETE /identity/v3/users/7b6390844fe548019ed76655ce56deca => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:57.705681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6cbe5-2807-4c10-adf7-3229ae156d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a680c20d4e14413d98b56ad61e0ddfde, user_id=58091ec20dda4c7eabc78061658a25c0, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:57.705790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.706115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.714719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.714854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6cbe5-2807-4c10-adf7-3229ae156d46 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:57.738054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:57.741090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.821184 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1171/2318] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:57.828334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.829614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1147/2318] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:57 2022] PUT /identity/v3/projects/a680c20d4e14413d98b56ad61e0ddfde/users/58091ec20dda4c7eabc78061658a25c0/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:57.831312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:57.831745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:57.832162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:57.834451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.863440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] MFA Rules not processed for user `58091ec20dda4c7eabc78061658a25c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:57.864663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:57.920355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a15d92-58a5-4b77-a78b-1635cfd410e8 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:57.944289 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1148/2319] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:57.950976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:57.954254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:58.007744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.008405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.008690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.009020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.035370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c553cf-7512-4a27-aeb7-56ee9c091942 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.040051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.040728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.041010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.041333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.042004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.043932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.069792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.071219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.081551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1172/2320] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:58.187487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1149/2321] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:22:57 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:22:58.188740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:58.200129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b39a-577c-4c2e-89bd-54cd1caa05ba service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.262646 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.263369 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.263651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.263918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.264618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.271945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.398647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1173/2322] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:22:58 2022] POST /identity/v3/users => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:22:58.403161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:58.413497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea7ee5-2840-4d1f-87ce-0ddeb9cfaf01 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.418156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.418806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.419088 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.419365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.420113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.421748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.432372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1150/2323] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:22:58.436668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:58.447782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10b95d-ad0a-4ab6-a2ec-59e9f4e7d756 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.452555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.453601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.453888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.454166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] PATH_INFO: `/v3/projects/5b93c121119b453484e1463943993ed1/users/09b3a2f9cbc748a0bf7af272288524a1/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.478778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b93c121119b453484e1463943993ed1, user_id=09b3a2f9cbc748a0bf7af272288524a1, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.482060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.614336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1174/2324] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:58 2022] PUT /identity/v3/projects/5b93c121119b453484e1463943993ed1/users/09b3a2f9cbc748a0bf7af272288524a1/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:58.618508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:58.628290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cadb7e-584d-49b0-86b4-a5e9515a9dab admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.683298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d4eaa-6652-4b7b-93d7-c978cebac692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.683921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4eaa-6652-4b7b-93d7-c978cebac692 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.684189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4eaa-6652-4b7b-93d7-c978cebac692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.684456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d4eaa-6652-4b7b-93d7-c978cebac692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.685211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4eaa-6652-4b7b-93d7-c978cebac692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.687055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d4eaa-6652-4b7b-93d7-c978cebac692 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.697073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1151/2325] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:22:58.701532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:58.712484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850c687-0e4a-4d14-ba12-f6ef30e208e9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.717207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.718440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.718721 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.719002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] PATH_INFO: `/v3/projects/5b93c121119b453484e1463943993ed1/users/09b3a2f9cbc748a0bf7af272288524a1/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.721108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b93c121119b453484e1463943993ed1, user_id=09b3a2f9cbc748a0bf7af272288524a1, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.723757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.735075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1175/2326] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:22:58 2022] PUT /identity/v3/projects/5b93c121119b453484e1463943993ed1/users/09b3a2f9cbc748a0bf7af272288524a1/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:58.745335 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.745662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.745938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.772438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] MFA Rules not processed for user `09b3a2f9cbc748a0bf7af272288524a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:58.773852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:58.776550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:58.778757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:58.857528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655e8dd-4341-4d0c-9e42-9de91264fc3b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.869390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.870386 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.871094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.871485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] PATH_INFO: `/v3/projects/08cefd8245534f1a91252530f90b017e` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.874490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1152/2327] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:22:58.875483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cefd8245534f1a91252530f90b017e)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.877532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.881754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:58.883185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:58.945623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12f113-0ad4-4aa7-8069-26ed1b038280 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:58.949782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:58.950454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:58.950741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:58.951020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:58.960106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:58.961569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:58.971509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1153/2328] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:22:59.030605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cefd8245534f1a91252530f90b017e', 'request_id': 'req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.115678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:59.117188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cefd8245534f1a91252530f90b017e', 'request_id': 'req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.126218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cefd8245534f1a91252530f90b017e', 'request_id': 'req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.127243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50be6fb-1aca-42ce-b62e-985a03ffbeb1 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:59.141070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] The token cache is being invalidate because project 08cefd8245534f1a91252530f90b017e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:22:59.141483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.142224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.144665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1176/2329] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:22:58 2022] DELETE /identity/v3/projects/08cefd8245534f1a91252530f90b017e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:22:59.148167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:59.149616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:59.198460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:59.199019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:59.199304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:59.199577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] PATH_INFO: `/v3/users/58091ec20dda4c7eabc78061658a25c0` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:59.209601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58091ec20dda4c7eabc78061658a25c0)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:59.211658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:59.251875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe503d-41fa-457d-b9f1-6e57c8c1b9cc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:59.257463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:59.258390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:59.258770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:59.259210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] PATH_INFO: `/v3/users/58dd83bc01f243e2b0d6040c578e4222` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:59.260523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58dd83bc01f243e2b0d6040c578e4222)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:59.262586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:59.387286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58091ec20dda4c7eabc78061658a25c0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.387997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58091ec20dda4c7eabc78061658a25c0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.427128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58dd83bc01f243e2b0d6040c578e4222'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.427781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58dd83bc01f243e2b0d6040c578e4222'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.439195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58dd83bc01f243e2b0d6040c578e4222'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.488279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58091ec20dda4c7eabc78061658a25c0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.500285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58091ec20dda4c7eabc78061658a25c0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.500955 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-43e7d0a7-b12e-4ed2-b97c-144ec2d0d661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58091ec20dda4c7eabc78061658a25c0'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.513053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1154/2330] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:59 2022] DELETE /identity/v3/users/58091ec20dda4c7eabc78061658a25c0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:59.514342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:59.514626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:59.514898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:59.541091 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] MFA Rules not processed for user `4bcbe4ee1dbf4c15a8f61fcb661452c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:59.543871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:59.562218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58dd83bc01f243e2b0d6040c578e4222'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.566747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d19d23ee-916e-4863-ac01-4aebf245c620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58dd83bc01f243e2b0d6040c578e4222'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:22:59.575436 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1177/2331] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:22:59 2022] DELETE /identity/v3/users/58dd83bc01f243e2b0d6040c578e4222 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:22:59.578643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:59.578643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:59.578643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:59.596217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:22:59.597455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:59.617434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1155/2332] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:59.623609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:59.625049 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:59.670709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1178/2333] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:22:59.677350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:22:59.678714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:59.687221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99f5da-0127-42ee-8cb3-a2a3e28b4ce9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:59.737319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:59.738077 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:59.738480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:59.738764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:59.738980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217550e-1e67-415c-91ab-e47c1011428c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:22:59.740653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:22:59.742788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:22:59.744001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:22:59.744286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:22:59.744564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:22:59.754720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:59.756160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:59.765909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1179/2334] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:22:59.799398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:22:59.800847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:22:59.811408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1156/2335] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:22:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:00.071010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:00.075285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:00.089354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860df18-3c59-4768-b1cc-aa371b363c1a service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:00.094249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:00.095632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.096131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.096643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] PATH_INFO: `/v3/projects/1fa77643174a46a9806973ff8940ba5c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.098115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa77643174a46a9806973ff8940ba5c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:00.102465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:00.267255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa77643174a46a9806973ff8940ba5c', 'request_id': 'req-530534fd-423c-4787-8c64-56f5bf68d93d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.324620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:00.328008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:00.345017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabac9ff-ea64-4743-94fa-9d4c30f26d9e service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:00.409757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:00.410694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.411385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.411385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] PATH_INFO: `/v3/projects/a680c20d4e14413d98b56ad61e0ddfde` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.412752 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a680c20d4e14413d98b56ad61e0ddfde)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:00.414764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:00.418142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa77643174a46a9806973ff8940ba5c', 'request_id': 'req-530534fd-423c-4787-8c64-56f5bf68d93d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.424628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa77643174a46a9806973ff8940ba5c', 'request_id': 'req-530534fd-423c-4787-8c64-56f5bf68d93d'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.438300 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] The token cache is being invalidate because project 1fa77643174a46a9806973ff8940ba5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:00.439299 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.439455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-530534fd-423c-4787-8c64-56f5bf68d93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.441318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1180/2336] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:00 2022] DELETE /identity/v3/projects/1fa77643174a46a9806973ff8940ba5c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:00.445761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9d0f-678d-4c8b-9eae-48889b85ccc6 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.446169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9d0f-678d-4c8b-9eae-48889b85ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.447264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9d0f-678d-4c8b-9eae-48889b85ccc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.469611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3d6a9d0f-678d-4c8b-9eae-48889b85ccc6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:00.471100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3d6a9d0f-678d-4c8b-9eae-48889b85ccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:00.479935 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1181/2337] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:00.487813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26f7a-cf34-4538-a042-65d9b0e62a3b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.488121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26f7a-cf34-4538-a042-65d9b0e62a3b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.488404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd26f7a-cf34-4538-a042-65d9b0e62a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.506993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ebd26f7a-cf34-4538-a042-65d9b0e62a3b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:00.508283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ebd26f7a-cf34-4538-a042-65d9b0e62a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:00.521988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1182/2338] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:00.526083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26f7a-cf34-4538-a042-65d9b0e62a3b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:00.535419 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd26f7a-cf34-4538-a042-65d9b0e62a3b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:00.537268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a680c20d4e14413d98b56ad61e0ddfde', 'request_id': 'req-47b1ea5c-609d-4abb-af59-fe09077351ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.592327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:00.592911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.593222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.593532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.594437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:00.594776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:00.596373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:00.609387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1183/2339] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:23:00.613662 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:00.624157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17b77a-36cc-4ccb-9d3b-abbb1fe70e15 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:00.629117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:00.629787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.630074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.630346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.631054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:00.632942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:00.643061 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a680c20d4e14413d98b56ad61e0ddfde', 'request_id': 'req-47b1ea5c-609d-4abb-af59-fe09077351ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.650532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a680c20d4e14413d98b56ad61e0ddfde', 'request_id': 'req-47b1ea5c-609d-4abb-af59-fe09077351ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.686284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] The token cache is being invalidate because project a680c20d4e14413d98b56ad61e0ddfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:00.687450 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.688267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.690033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1157/2340] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:00 2022] DELETE /identity/v3/projects/a680c20d4e14413d98b56ad61e0ddfde => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:00.693669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:00.695275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:00.708633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1ea5c-609d-4abb-af59-fe09077351ef admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:00.715067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:00.715959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.716239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.716511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] PATH_INFO: `/v3/users/09b3a2f9cbc748a0bf7af272288524a1` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.717770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b3a2f9cbc748a0bf7af272288524a1)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:00.719661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:00.754884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1184/2341] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:00 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:00.759322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:00.761042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:00.824117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472f6b0-2e67-4f51-8ade-ca3a3e0b3fff admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:00.830499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:00.831185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.831470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.831762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.832471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:00.834462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:00.958860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1185/2342] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:00 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:00.960114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:00.973474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55955cc-0789-492a-9b4b-dcaab244abd5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:00.974553 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b3a2f9cbc748a0bf7af272288524a1'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.976080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b3a2f9cbc748a0bf7af272288524a1'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:00.981146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:00.982569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:00.982940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:00.983312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:00.984122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:00.985886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:00.996303 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1186/2343] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:01.000285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.011028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350567b-bbf8-4a4e-a9c2-933f350ae592 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.015823 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.017377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.017663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.017967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.018703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.020321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:01.031089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1187/2344] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:23:01.039189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.049045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55f03-3e23-4117-bb90-9fb99b9cb140 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.053768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.054617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.054904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.055186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] PATH_INFO: `/v3/projects/fe17e05c61bc462d8c131ebb9c2ed243/users/a3c3337ff7154c4481b8253ccbb284fe/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.069691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe17e05c61bc462d8c131ebb9c2ed243, user_id=a3c3337ff7154c4481b8253ccbb284fe, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.073064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:01.100117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b3a2f9cbc748a0bf7af272288524a1'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:01.113164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b3a2f9cbc748a0bf7af272288524a1'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:01.114213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a41a508f-c54e-4d9e-9d5d-4b7a60a9fc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b3a2f9cbc748a0bf7af272288524a1'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:01.126937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1158/2345] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:00 2022] DELETE /identity/v3/users/09b3a2f9cbc748a0bf7af272288524a1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:01.208335 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1188/2346] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:01 2022] PUT /identity/v3/projects/fe17e05c61bc462d8c131ebb9c2ed243/users/a3c3337ff7154c4481b8253ccbb284fe/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:01.219898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e498d6-4f3f-4502-bf3e-441e2308efc7 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.220187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e498d6-4f3f-4502-bf3e-441e2308efc7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.220468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e498d6-4f3f-4502-bf3e-441e2308efc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.249137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-29e498d6-4f3f-4502-bf3e-441e2308efc7 None None] MFA Rules not processed for user `a3c3337ff7154c4481b8253ccbb284fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:01.250426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-29e498d6-4f3f-4502-bf3e-441e2308efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:01.315651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1159/2347] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:01.320381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.322098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:01.389142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601e0c-1040-4abe-8b69-9be8bb0c24fb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.394766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.395515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.395872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.396222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.401514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.403834 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:01.596924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1189/2348] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:01 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:01.601196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e498d6-4f3f-4502-bf3e-441e2308efc7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.612915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e498d6-4f3f-4502-bf3e-441e2308efc7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.676572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.680221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.680221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.680221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.680221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.680579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:01.778544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.780274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:01.807704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1160/2349] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:01 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:01.811413 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.821000 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f226f9d-27fb-41e6-92ca-238b6686c53a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.825777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.826410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.826693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.826971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.827786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.829375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:01.839587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1161/2350] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:23:01.843080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9f38-25f0-454c-b04f-2199829eb070 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.843630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.846861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.853431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.853431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.853431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.853431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:01.853751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7cd77-ce4a-41c0-8db8-2ac8d8214c3b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.858251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.859099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.859382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.859656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] PATH_INFO: `/v3/projects/8fab3f5037444b03a5eb05bd28e58e36/users/b835605112a34ad5968e4bacb0c00b4c/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.873880 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fab3f5037444b03a5eb05bd28e58e36, user_id=b835605112a34ad5968e4bacb0c00b4c, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.876491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:01.912963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.914410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:01.924213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1190/2351] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:23:01.924915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:01.926240 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:01.939515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac1df9-9c64-4b23-92dd-d59982b22469 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:01.944837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:01.945867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:01.946152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:01.946975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] PATH_INFO: `/v3/projects/5b93c121119b453484e1463943993ed1` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:01.948210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b93c121119b453484e1463943993ed1)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:01.950174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.001297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1162/2352] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:01 2022] PUT /identity/v3/projects/8fab3f5037444b03a5eb05bd28e58e36/users/b835605112a34ad5968e4bacb0c00b4c/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:02.005471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.067617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf978-e372-4b33-8781-cd22745fa1c3 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.073194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.074451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.074764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.075040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.075813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.077468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.092930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1163/2353] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:23:02.093892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.103900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45f545-a168-427f-9867-17e014419a47 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.116690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b93c121119b453484e1463943993ed1', 'request_id': 'req-5e1ab05c-60e4-458c-b83e-35b0d916a98f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:02.172674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142ebc2-a178-4220-ba6a-086b3a4e181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.173589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ebc2-a178-4220-ba6a-086b3a4e181f admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.173887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ebc2-a178-4220-ba6a-086b3a4e181f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.174135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ebc2-a178-4220-ba6a-086b3a4e181f admin admin] PATH_INFO: `/v3/projects/8fab3f5037444b03a5eb05bd28e58e36/users/b835605112a34ad5968e4bacb0c00b4c/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.176246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142ebc2-a178-4220-ba6a-086b3a4e181f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fab3f5037444b03a5eb05bd28e58e36, user_id=b835605112a34ad5968e4bacb0c00b4c, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.178945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142ebc2-a178-4220-ba6a-086b3a4e181f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.190491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1164/2354] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:02 2022] PUT /identity/v3/projects/8fab3f5037444b03a5eb05bd28e58e36/users/b835605112a34ad5968e4bacb0c00b4c/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:02.200440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b93c121119b453484e1463943993ed1', 'request_id': 'req-5e1ab05c-60e4-458c-b83e-35b0d916a98f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:02.203133 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.203420 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.203692 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.208407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b93c121119b453484e1463943993ed1', 'request_id': 'req-5e1ab05c-60e4-458c-b83e-35b0d916a98f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:02.233246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] MFA Rules not processed for user `b835605112a34ad5968e4bacb0c00b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:02.234744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:02.235889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] The token cache is being invalidate because project 5b93c121119b453484e1463943993ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:02.236329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:02.237420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-5e1ab05c-60e4-458c-b83e-35b0d916a98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:02.239336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1191/2355] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:01 2022] DELETE /identity/v3/projects/5b93c121119b453484e1463943993ed1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:02.249030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733b97-ca8b-4af5-8fa9-3ceddb4b44a7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.249578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733b97-ca8b-4af5-8fa9-3ceddb4b44a7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.250076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733b97-ca8b-4af5-8fa9-3ceddb4b44a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.274109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-78733b97-ca8b-4af5-8fa9-3ceddb4b44a7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:02.275358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-78733b97-ca8b-4af5-8fa9-3ceddb4b44a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:02.328517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1165/2356] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:02.339714 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.341653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:02.351824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1192/2357] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:02.361234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ed3f0-2129-4ac1-83cf-b8748786873c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.361557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ed3f0-2129-4ac1-83cf-b8748786873c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.361841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ed3f0-2129-4ac1-83cf-b8748786873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.380043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-be6ed3f0-2129-4ac1-83cf-b8748786873c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:02.381247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-be6ed3f0-2129-4ac1-83cf-b8748786873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:02.390461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1193/2358] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:02.394577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ed3f0-2129-4ac1-83cf-b8748786873c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.405190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ed3f0-2129-4ac1-83cf-b8748786873c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.405397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd64a-311e-4be1-aaef-c11a9cc48086 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.410655 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.411308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.411611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.411892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.422422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.424217 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.425137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.425382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.425494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.425905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.426808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:02.427466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.429395 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.440493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1166/2359] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:23:02.451574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1194/2360] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:23:02.453119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.467711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f05a13-dbc8-4a3a-a790-d532cec5a650 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.475404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.476993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.478145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.478426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.479281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.481736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.549886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.578732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e4f5-858e-4cb9-838b-0ac890efffc4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.578732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.578732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.578732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.579414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.579414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:02.607034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1167/2361] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:02 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:02.611623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.667632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.669375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.702692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1195/2362] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:23:02.710205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb65d6a-65f7-4e62-96b9-6983f28655fd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.719188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.719944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.720301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.720881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.721702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.724493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.906371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1168/2363] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:02 2022] POST /identity/v3/users => generated 284 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:02.910582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.921177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160b7c-33b8-4fc5-93d9-0ba9f549ac04 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.925706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.926344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.926631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.926907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.927653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.929251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.939483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1196/2364] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:02.943877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:02.962865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ac86b-f70a-4659-83ad-8aabe514e331 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:02.970319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393df37-5d72-42bc-a171-403373dce027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:02.971018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393df37-5d72-42bc-a171-403373dce027 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:02.971436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393df37-5d72-42bc-a171-403373dce027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:02.971833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393df37-5d72-42bc-a171-403373dce027 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:02.972599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393df37-5d72-42bc-a171-403373dce027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:02.974180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393df37-5d72-42bc-a171-403373dce027 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:02.986810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1169/2365] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:02.991122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:03.002372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11561767-3d2e-4291-a91c-8d6c1ad7ce47 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:03.007503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:03.008423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.008821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.009692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] PATH_INFO: `/v3/projects/bc5dd17464094c28ad5663f1b40fda31/users/090f64b33c4f445aa67df7e7251f2484/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.025536 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5dd17464094c28ad5663f1b40fda31, user_id=090f64b33c4f445aa67df7e7251f2484, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:03.028164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:03.108782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1197/2366] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:02 2022] PUT /identity/v3/projects/bc5dd17464094c28ad5663f1b40fda31/users/090f64b33c4f445aa67df7e7251f2484/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:03.126615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995c20-26ed-4998-8501-fe4a56484c0c None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.127021 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995c20-26ed-4998-8501-fe4a56484c0c None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.127378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5995c20-26ed-4998-8501-fe4a56484c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.156274 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-d5995c20-26ed-4998-8501-fe4a56484c0c None None] MFA Rules not processed for user `090f64b33c4f445aa67df7e7251f2484`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:03.157567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d5995c20-26ed-4998-8501-fe4a56484c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:03.229932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1170/2367] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:03.234597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:03.306342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388df4d-a1e9-4435-b183-79cfec966ddf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:03.311506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:03.311909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.312196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.312475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.313183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:03.315109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:03.430814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1198/2368] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:03 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:03.431982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5995c20-26ed-4998-8501-fe4a56484c0c None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:03.445432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5995c20-26ed-4998-8501-fe4a56484c0c None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:03.503247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:03.503952 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.504222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.504475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.505169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:03.507171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:03.609317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1171/2369] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:03 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:03.612992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:03.625731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147de8-35c0-4859-a2f6-5cf46c47e397 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:03.630813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:03.631766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.632132 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.632411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.633309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:03.635636 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:03.647839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1199/2370] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:23:03.660908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:03.671172 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22d156-93e4-4084-bcea-98959e9fb779 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:03.676248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:03.677187 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.677507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.677791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] PATH_INFO: `/v3/projects/ed0a166f554848dd9fed223415435e72/users/2080b27190e24b4cb08ae60fac0b2f48/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.692597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0a166f554848dd9fed223415435e72, user_id=2080b27190e24b4cb08ae60fac0b2f48, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:03.695194 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:03.843731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1172/2371] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:03 2022] PUT /identity/v3/projects/ed0a166f554848dd9fed223415435e72/users/2080b27190e24b4cb08ae60fac0b2f48/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:03.847709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:03.858172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9ed68-1526-4094-886e-62ed80087dff admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:03.918046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55091c33-b9f3-432a-90be-477199c1c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:03.918715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55091c33-b9f3-432a-90be-477199c1c0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.918974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55091c33-b9f3-432a-90be-477199c1c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.919255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55091c33-b9f3-432a-90be-477199c1c0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.919984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55091c33-b9f3-432a-90be-477199c1c0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:03.921689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55091c33-b9f3-432a-90be-477199c1c0a6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:03.931784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1200/2372] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:03.936109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:03.947514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f9d5d-bca4-4ccd-a0f4-f7a23444231f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:03.952265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:03.953208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.953517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.953793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] PATH_INFO: `/v3/projects/ed0a166f554848dd9fed223415435e72/users/2080b27190e24b4cb08ae60fac0b2f48/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:03.955832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0a166f554848dd9fed223415435e72, user_id=2080b27190e24b4cb08ae60fac0b2f48, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:03.958559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:03.968826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1173/2373] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:03 2022] PUT /identity/v3/projects/ed0a166f554848dd9fed223415435e72/users/2080b27190e24b4cb08ae60fac0b2f48/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:03.979289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb80ce-ede3-44fa-a01b-3c5a5efe2534 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:03.979584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb80ce-ede3-44fa-a01b-3c5a5efe2534 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:03.979868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb80ce-ede3-44fa-a01b-3c5a5efe2534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:04.007074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-32cb80ce-ede3-44fa-a01b-3c5a5efe2534 None None] MFA Rules not processed for user `2080b27190e24b4cb08ae60fac0b2f48`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:04.008293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-32cb80ce-ede3-44fa-a01b-3c5a5efe2534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:04.083011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1201/2374] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:04.217195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:04.218938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:04.279230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89ab1-7065-467f-bd7a-2792259b40f7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:04.283617 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:04.284326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:04.285410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:04.285410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:04.294973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:04.296578 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:04.306719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1174/2375] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:04.600770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb80ce-ede3-44fa-a01b-3c5a5efe2534 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:04.611220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb80ce-ede3-44fa-a01b-3c5a5efe2534 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:04.615241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9dfa8-930f-4897-a934-89716329dc1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:04.615886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dfa8-930f-4897-a934-89716329dc1c service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:04.616172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dfa8-930f-4897-a934-89716329dc1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:04.616579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dfa8-930f-4897-a934-89716329dc1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:04.674586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9dfa8-930f-4897-a934-89716329dc1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:04.676051 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9dfa8-930f-4897-a934-89716329dc1c service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:04.693456 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1202/2376] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:06.006294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:06.008242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:06.075944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402e472-9268-4f9c-81db-388d0cdb8e8e service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:06.080489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:06.081372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:06.081656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:06.081932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] PATH_INFO: `/v3/users/a3c3337ff7154c4481b8253ccbb284fe` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:06.083162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c3337ff7154c4481b8253ccbb284fe)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:06.085144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:06.415517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c3337ff7154c4481b8253ccbb284fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:06.416106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c3337ff7154c4481b8253ccbb284fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:06.483112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c3337ff7154c4481b8253ccbb284fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:06.496706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c3337ff7154c4481b8253ccbb284fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:06.497515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c3337ff7154c4481b8253ccbb284fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:06.510886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1175/2377] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:06 2022] DELETE /identity/v3/users/a3c3337ff7154c4481b8253ccbb284fe => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:06.515561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:06.516138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:06.516216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:06.538482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:06.539781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:06.616393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1203/2378] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:06.631372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:06.632785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:06.692475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a490d48-ba95-4efa-a931-af5c97a611d1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:06.695986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:06.697169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:06.697479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:06.697751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:06.706492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:06.709410 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:06.721076 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1176/2379] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:07.224781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:07.228144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:07.249668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfffa6-194b-4060-b6c5-6c8207a46686 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:07.259510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:07.260447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:07.260734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:07.261015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] PATH_INFO: `/v3/projects/fe17e05c61bc462d8c131ebb9c2ed243` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:07.262322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe17e05c61bc462d8c131ebb9c2ed243)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:07.272546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:07.447322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe17e05c61bc462d8c131ebb9c2ed243', 'request_id': 'req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:07.551084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe17e05c61bc462d8c131ebb9c2ed243', 'request_id': 'req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:07.556762 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe17e05c61bc462d8c131ebb9c2ed243', 'request_id': 'req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:07.567640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] The token cache is being invalidate because project fe17e05c61bc462d8c131ebb9c2ed243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:07.567926 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:07.568563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:07.570192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1204/2380] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:07 2022] DELETE /identity/v3/projects/fe17e05c61bc462d8c131ebb9c2ed243 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:07.574186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:07.583778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4756f09-54a5-433d-9337-41fdc56e19a7 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:07.640296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:07.641195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:07.641518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:07.641793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] PATH_INFO: `/v3/users/b835605112a34ad5968e4bacb0c00b4c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:07.643132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b835605112a34ad5968e4bacb0c00b4c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:07.645155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:08.021236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b835605112a34ad5968e4bacb0c00b4c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:08.021912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b835605112a34ad5968e4bacb0c00b4c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:08.139097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b835605112a34ad5968e4bacb0c00b4c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:08.151567 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b835605112a34ad5968e4bacb0c00b4c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:08.152193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a7c111a-73a8-42ac-b386-48be445b9dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b835605112a34ad5968e4bacb0c00b4c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:08.163749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1177/2381] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:07 2022] DELETE /identity/v3/users/b835605112a34ad5968e4bacb0c00b4c => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:08.641615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:08.643628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:08.664368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f36c7-9e4b-4c5d-9022-68a89dc8f53e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:08.722652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:08.723854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:08.723854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:08.724094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] PATH_INFO: `/v3/projects/8fab3f5037444b03a5eb05bd28e58e36` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:08.725259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fab3f5037444b03a5eb05bd28e58e36)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:08.727176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:08.876956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fab3f5037444b03a5eb05bd28e58e36', 'request_id': 'req-6725ab93-9e2f-4e65-a7df-3cda582735c4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:09.006333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fab3f5037444b03a5eb05bd28e58e36', 'request_id': 'req-6725ab93-9e2f-4e65-a7df-3cda582735c4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:09.014403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fab3f5037444b03a5eb05bd28e58e36', 'request_id': 'req-6725ab93-9e2f-4e65-a7df-3cda582735c4'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:09.027029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] The token cache is being invalidate because project 8fab3f5037444b03a5eb05bd28e58e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:09.027324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:09.027976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6725ab93-9e2f-4e65-a7df-3cda582735c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:09.029790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1205/2382] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:08 2022] DELETE /identity/v3/projects/8fab3f5037444b03a5eb05bd28e58e36 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:09.035419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac980-708a-4472-a4d1-a365556e3c9e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.036243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac980-708a-4472-a4d1-a365556e3c9e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.036846 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac980-708a-4472-a4d1-a365556e3c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.057379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-cacac980-708a-4472-a4d1-a365556e3c9e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:09.058797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cacac980-708a-4472-a4d1-a365556e3c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:09.121272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1178/2383] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:09.129166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8276-900e-4433-8863-4d609f9c15e4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.129483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8276-900e-4433-8863-4d609f9c15e4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.129766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb8276-900e-4433-8863-4d609f9c15e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.148100 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-48eb8276-900e-4433-8863-4d609f9c15e4 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:09.149885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-48eb8276-900e-4433-8863-4d609f9c15e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:09.157745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1206/2384] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:09.162076 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacac980-708a-4472-a4d1-a365556e3c9e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:09.173038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacac980-708a-4472-a4d1-a365556e3c9e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:09.178104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:09.178733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.179009 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.179284 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.180003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:09.180310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:09.182057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:09.195106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1179/2385] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:23:09.208756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb8276-900e-4433-8863-4d609f9c15e4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:09.220146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb8276-900e-4433-8863-4d609f9c15e4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:09.225162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:09.225907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.226195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.226470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.227287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:09.229965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:09.321902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1207/2386] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:09 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:09.329559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:09.336498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62ebc-1be4-44d1-b630-8bfc0ba604c9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:09.400266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:09.401130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.401562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.401981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.402791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:09.404754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:09.529799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1180/2387] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:09 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:09.533990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:09.545219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6432e-05e3-4931-86e7-09cbbc3418f4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:09.550030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:09.550694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.551084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.551366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.552111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:09.553805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:09.564464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1208/2388] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:09.568302 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:09.584255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73edf5-6df8-4948-a4fd-67b015d2285f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:09.591216 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688d93a-28ac-47a2-98ef-5559429a3e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:09.592055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688d93a-28ac-47a2-98ef-5559429a3e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.592506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688d93a-28ac-47a2-98ef-5559429a3e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.592901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688d93a-28ac-47a2-98ef-5559429a3e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.593681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688d93a-28ac-47a2-98ef-5559429a3e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:09.595562 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688d93a-28ac-47a2-98ef-5559429a3e6e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:09.609597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1181/2389] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:09.614465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:09.625186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302ad49-8e82-49db-99e4-2838e019d9f0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:09.630148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:09.631672 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.632096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.632498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] PATH_INFO: `/v3/projects/9562939d04a04f868c738263f2375b8e/users/489271f8dc5a432792bea8521abf5eb8/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.648754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9562939d04a04f868c738263f2375b8e, user_id=489271f8dc5a432792bea8521abf5eb8, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:09.652173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:09.774540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1209/2390] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:09 2022] PUT /identity/v3/projects/9562939d04a04f868c738263f2375b8e/users/489271f8dc5a432792bea8521abf5eb8/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:09.779370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.779805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.780180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.804814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:09.806950 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:09.873888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1182/2391] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:09.883360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:09.886576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:09.946849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7bf68-3b9f-435a-b9d7-8248f0c1169a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:09.950795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13755f8-f6e2-481a-9f3c-c4e8737e0a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:09.951526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13755f8-f6e2-481a-9f3c-c4e8737e0a9d service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:09.952016 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13755f8-f6e2-481a-9f3c-c4e8737e0a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:09.952465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13755f8-f6e2-481a-9f3c-c4e8737e0a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:09.964608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13755f8-f6e2-481a-9f3c-c4e8737e0a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:09.966105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13755f8-f6e2-481a-9f3c-c4e8737e0a9d service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:09.975922 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1210/2392] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:11.866128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:11.867626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:11.880440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6784f60-40a6-41fd-b927-a590f66f429d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:11.885248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:11.886134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:11.886435 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:11.886705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] PATH_INFO: `/v3/users/090f64b33c4f445aa67df7e7251f2484` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:11.887899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=090f64b33c4f445aa67df7e7251f2484)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:11.889821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:12.119090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090f64b33c4f445aa67df7e7251f2484'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:12.119737 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090f64b33c4f445aa67df7e7251f2484'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:12.191576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090f64b33c4f445aa67df7e7251f2484'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:12.212525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090f64b33c4f445aa67df7e7251f2484'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:12.213520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090f64b33c4f445aa67df7e7251f2484'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:12.232002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1183/2393] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:11 2022] DELETE /identity/v3/users/090f64b33c4f445aa67df7e7251f2484 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:12.233417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:12.233912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:12.234015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:12.258898 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:12.262045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:12.357443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1211/2394] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:12.374621 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:12.376786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:12.462953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c28310-c613-4977-883c-25ff3a322dfe admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:12.469932 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:12.471090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:12.471475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:12.471901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:12.484994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:12.486719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:12.504378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1184/2395] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:13.197622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:13.199188 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:13.211603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba71a0d-5d2f-427f-adb8-e36cb7dd46fc None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:13.221658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:13.221658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:13.221658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:13.221658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] PATH_INFO: `/v3/projects/bc5dd17464094c28ad5663f1b40fda31` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:13.222351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5dd17464094c28ad5663f1b40fda31)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:13.222351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:13.372420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5dd17464094c28ad5663f1b40fda31', 'request_id': 'req-1ce9937d-7db2-489d-8843-138f57ccd62e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:13.503889 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5dd17464094c28ad5663f1b40fda31', 'request_id': 'req-1ce9937d-7db2-489d-8843-138f57ccd62e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:13.512660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5dd17464094c28ad5663f1b40fda31', 'request_id': 'req-1ce9937d-7db2-489d-8843-138f57ccd62e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:13.529001 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] The token cache is being invalidate because project bc5dd17464094c28ad5663f1b40fda31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:13.529310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:13.530797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:13.532360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1212/2396] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:13 2022] DELETE /identity/v3/projects/bc5dd17464094c28ad5663f1b40fda31 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:13.536517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:13.547191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e939-d1c6-4909-b25e-24413cdfb05b service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:13.611376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:13.612377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:13.612725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:13.613102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] PATH_INFO: `/v3/users/2080b27190e24b4cb08ae60fac0b2f48` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:13.622893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2080b27190e24b4cb08ae60fac0b2f48)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:13.625177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:13.893818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2080b27190e24b4cb08ae60fac0b2f48'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:13.897223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2080b27190e24b4cb08ae60fac0b2f48'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:13.991296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2080b27190e24b4cb08ae60fac0b2f48'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:14.014263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2080b27190e24b4cb08ae60fac0b2f48'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:14.015161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f2e19a67-7098-4b1d-8b40-d6a3c6ea95d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2080b27190e24b4cb08ae60fac0b2f48'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:14.034122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1185/2397] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:13 2022] DELETE /identity/v3/users/2080b27190e24b4cb08ae60fac0b2f48 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:14.514808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:14.518568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:14.534850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9937d-7db2-489d-8843-138f57ccd62e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:14.594133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:14.594993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:14.595312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:14.595587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] PATH_INFO: `/v3/projects/ed0a166f554848dd9fed223415435e72` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:14.596786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0a166f554848dd9fed223415435e72)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:14.598700 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:14.762962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0a166f554848dd9fed223415435e72', 'request_id': 'req-339b69cd-fa9c-4a1c-9660-228aa94b07dd'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:14.990180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0a166f554848dd9fed223415435e72', 'request_id': 'req-339b69cd-fa9c-4a1c-9660-228aa94b07dd'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:15.003378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0a166f554848dd9fed223415435e72', 'request_id': 'req-339b69cd-fa9c-4a1c-9660-228aa94b07dd'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:15.032440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] The token cache is being invalidate because project ed0a166f554848dd9fed223415435e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:15.033080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:15.034055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-339b69cd-fa9c-4a1c-9660-228aa94b07dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:15.037181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1213/2398] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:14 2022] DELETE /identity/v3/projects/ed0a166f554848dd9fed223415435e72 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:15.043015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2896-18c3-4a5c-a2da-edbecc7e8b42 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.044432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2896-18c3-4a5c-a2da-edbecc7e8b42 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.044966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2896-18c3-4a5c-a2da-edbecc7e8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.070320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-84de2896-18c3-4a5c-a2da-edbecc7e8b42 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:15.073155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-84de2896-18c3-4a5c-a2da-edbecc7e8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:15.178454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1186/2399] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:15.187085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359462-1701-4806-b36a-8ab9c8ff2818 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.187506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359462-1701-4806-b36a-8ab9c8ff2818 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.187890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359462-1701-4806-b36a-8ab9c8ff2818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.210028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a7359462-1701-4806-b36a-8ab9c8ff2818 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:15.211199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a7359462-1701-4806-b36a-8ab9c8ff2818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:15.222560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1214/2400] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:15.226939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de2896-18c3-4a5c-a2da-edbecc7e8b42 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:15.240364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de2896-18c3-4a5c-a2da-edbecc7e8b42 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:15.246136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:15.246738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.247017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.247291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.248218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:15.248530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:15.250308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:15.263368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1187/2401] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:23:15.268708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359462-1701-4806-b36a-8ab9c8ff2818 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:15.281508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359462-1701-4806-b36a-8ab9c8ff2818 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:15.288876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:15.289608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.290039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.290602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.291318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:15.293433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:15.388098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1215/2402] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:15 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:15.395136 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:15.408178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f00a7-a937-45e4-9009-5dd97c629715 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:15.485575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:15.491397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.491397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.491397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.491397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:15.492363 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:15.588579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1188/2403] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:15 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:15.592624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:15.603396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ff2ef-90f2-4eda-bfda-b0eddc47cb58 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:15.608526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:15.609189 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.609521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.609815 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.610671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:15.612557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:15.623666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1216/2404] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:15.627615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:15.637723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353168-c10d-4b19-99dd-1514856bcd91 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:15.644334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4018450-ae70-412c-bdf3-674b4e61fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:15.645034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018450-ae70-412c-bdf3-674b4e61fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.645337 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018450-ae70-412c-bdf3-674b4e61fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.645718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4018450-ae70-412c-bdf3-674b4e61fae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.646636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4018450-ae70-412c-bdf3-674b4e61fae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:15.648347 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4018450-ae70-412c-bdf3-674b4e61fae4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:15.661632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1189/2405] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:15.663087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:15.673697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb955326-c151-4ed6-8faa-95c2af43373d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:15.679297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:15.680257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.680592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.681488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] PATH_INFO: `/v3/projects/b7b7680c7e114cd0b2d7ab9e9620d7a2/users/5d9dd04b741647b0b3c2328a1880e41d/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.696218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b7680c7e114cd0b2d7ab9e9620d7a2, user_id=5d9dd04b741647b0b3c2328a1880e41d, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:15.699168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:15.799920 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1217/2406] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:15 2022] PUT /identity/v3/projects/b7b7680c7e114cd0b2d7ab9e9620d7a2/users/5d9dd04b741647b0b3c2328a1880e41d/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:15.810677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4f211-f199-42cc-a832-706d4bb8b7ce None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:15.810967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4f211-f199-42cc-a832-706d4bb8b7ce None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:15.811253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4f211-f199-42cc-a832-706d4bb8b7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:15.854281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6ff4f211-f199-42cc-a832-706d4bb8b7ce None None] MFA Rules not processed for user `5d9dd04b741647b0b3c2328a1880e41d`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:15.855736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6ff4f211-f199-42cc-a832-706d4bb8b7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:15.932640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1190/2407] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:15.937221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:16.050283 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4963993-7e5c-4f84-96e2-00b5c9441175 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:16.056916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:16.057778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:16.058421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:16.058773 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:16.059709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:16.061664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:16.200750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1218/2408] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:15 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:16.204668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4f211-f199-42cc-a832-706d4bb8b7ce None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:16.216075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4f211-f199-42cc-a832-706d4bb8b7ce None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:16.348115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:16.349054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:16.349568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:16.349964 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:16.362220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:16.362220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:16.467865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1191/2409] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:16 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:16.470350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:16.484857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1480b0-3965-467c-8822-7270d4877a5b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:16.491258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:16.495904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:16.495904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:16.495904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:16.495904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:16.498137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:16.518786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1219/2410] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:16.519927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:16.538624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011744ab-6ddc-4262-8ee9-b7225912415a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:16.544430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:16.545455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:16.545865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:16.546232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] PATH_INFO: `/v3/projects/030280dff30e4837a7eb18ab8b258461/users/669fee18cf4543a98f029f5d8ade1ccf/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:16.563169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030280dff30e4837a7eb18ab8b258461, user_id=669fee18cf4543a98f029f5d8ade1ccf, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:16.566019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:16.648296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1192/2411] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:16 2022] PUT /identity/v3/projects/030280dff30e4837a7eb18ab8b258461/users/669fee18cf4543a98f029f5d8ade1ccf/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:16.652772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:16.663158 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfb86-b3d9-4524-8583-4118e461d24d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:16.775039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b1165-c3ea-439a-ab54-c6b55a509ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:16.775961 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1165-c3ea-439a-ab54-c6b55a509ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:16.776924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1165-c3ea-439a-ab54-c6b55a509ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:16.777253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b1165-c3ea-439a-ab54-c6b55a509ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:16.778467 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b1165-c3ea-439a-ab54-c6b55a509ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:16.780929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b1165-c3ea-439a-ab54-c6b55a509ce4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:16.801811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1220/2412] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:16.805739 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:16.831004 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a939f-49a6-45dd-aa3c-11c222f33f84 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:16.844134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:16.845165 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:16.846840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:16.848342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] PATH_INFO: `/v3/projects/030280dff30e4837a7eb18ab8b258461/users/669fee18cf4543a98f029f5d8ade1ccf/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:16.852182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=030280dff30e4837a7eb18ab8b258461, user_id=669fee18cf4543a98f029f5d8ade1ccf, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:16.858517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:16.904855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1193/2413] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:16 2022] PUT /identity/v3/projects/030280dff30e4837a7eb18ab8b258461/users/669fee18cf4543a98f029f5d8ade1ccf/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:16.918028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ae48-622c-4150-8fe6-4b63c2550c71 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:16.918554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ae48-622c-4150-8fe6-4b63c2550c71 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:16.929326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ae48-622c-4150-8fe6-4b63c2550c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:16.990276 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d731ae48-622c-4150-8fe6-4b63c2550c71 None None] MFA Rules not processed for user `669fee18cf4543a98f029f5d8ade1ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:16.993089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d731ae48-622c-4150-8fe6-4b63c2550c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:17.119522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1221/2414] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:17.128909 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:17.130816 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:17.246995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37c70-fd87-4ab8-b82d-796f20c6fb4d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:17.253860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:17.254741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:17.255412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:17.255823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:17.260851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee662-d9f8-4134-bdd2-75784c2d3162 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:17.261578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee662-d9f8-4134-bdd2-75784c2d3162 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:17.261578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee662-d9f8-4134-bdd2-75784c2d3162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:17.276121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:17.277644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:17.288840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1194/2415] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:17.305342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3b4ee662-d9f8-4134-bdd2-75784c2d3162 None None] MFA Rules not processed for user `489271f8dc5a432792bea8521abf5eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:17.307413 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3b4ee662-d9f8-4134-bdd2-75784c2d3162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:17.405054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1222/2416] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:17.406387 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:17.407827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:17.487272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3874d0a-ff8e-421e-bce2-e57925aeb874 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:17.494438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:17.497198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:17.497198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:17.497198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:17.497198 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:17.498442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:17.602174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1195/2417] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:17 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:17.604355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ee662-d9f8-4134-bdd2-75784c2d3162 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:17.617338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ee662-d9f8-4134-bdd2-75784c2d3162 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:17.697472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:17.698266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:17.698617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:17.698960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:17.699794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:17.701845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:17.851263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1223/2418] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:17 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:17.853081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:17.863443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987c492-4d88-474d-b121-4f2b64baf651 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:17.868058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:17.869241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:17.869550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:17.869842 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:17.870579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:17.872186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:17.882790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1196/2419] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:23:17.887006 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:17.897116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6337c-9901-4d77-8a48-fd27e89e921a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:17.902034 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:17.903057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:17.903416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:17.903967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] PATH_INFO: `/v3/projects/d2d151eaae9c4abfbfde825711ad3fe2/users/4a5cac73601b499c9963d1adfbf2cd4e/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:17.923858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d151eaae9c4abfbfde825711ad3fe2, user_id=4a5cac73601b499c9963d1adfbf2cd4e, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:17.923858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:18.033862 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1224/2420] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:17 2022] PUT /identity/v3/projects/d2d151eaae9c4abfbfde825711ad3fe2/users/4a5cac73601b499c9963d1adfbf2cd4e/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:18.037931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:18.051881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7276b91-2384-402e-8801-11c44db47dac admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:18.122806 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:18.128746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:18.129815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:18.133730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:18.133730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:18.133730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:18.146898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1197/2421] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:18.151150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:18.170515 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d884-e114-4bef-9a5b-4daff6f108ae admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:18.179723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55f54-4283-489c-805c-df056b018269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:18.180732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55f54-4283-489c-805c-df056b018269 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:18.181013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55f54-4283-489c-805c-df056b018269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:18.181766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55f54-4283-489c-805c-df056b018269 admin admin] PATH_INFO: `/v3/projects/d2d151eaae9c4abfbfde825711ad3fe2/users/4a5cac73601b499c9963d1adfbf2cd4e/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:18.183972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55f54-4283-489c-805c-df056b018269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d151eaae9c4abfbfde825711ad3fe2, user_id=4a5cac73601b499c9963d1adfbf2cd4e, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:18.186638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55f54-4283-489c-805c-df056b018269 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:18.200320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1225/2422] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:18 2022] PUT /identity/v3/projects/d2d151eaae9c4abfbfde825711ad3fe2/users/4a5cac73601b499c9963d1adfbf2cd4e/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:18.752458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:18.765150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f3c7-56df-4911-9eba-491a938be2cc admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:18.908465 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:18.910012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:18.910899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:18.911276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] PATH_INFO: `/v3/users/5d9dd04b741647b0b3c2328a1880e41d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:18.912903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9dd04b741647b0b3c2328a1880e41d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:18.916261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:19.185784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9dd04b741647b0b3c2328a1880e41d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:19.191081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9dd04b741647b0b3c2328a1880e41d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:19.299852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9dd04b741647b0b3c2328a1880e41d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:19.324789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9dd04b741647b0b3c2328a1880e41d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:19.328485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9dd04b741647b0b3c2328a1880e41d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:19.356945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1198/2423] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:18 2022] DELETE /identity/v3/users/5d9dd04b741647b0b3c2328a1880e41d => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:19.361931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:19.362449 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:19.362604 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:19.397160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:19.398683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:19.516491 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1226/2424] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:19.541827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:19.544024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:19.671149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4705-19c8-4062-a1df-bcefc667ef51 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:19.675588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:19.676253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:19.676521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:19.676799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:19.701614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:19.703125 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:19.731588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1199/2425] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:20.689924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:20.693206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:20.729081 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d5e3e-6749-4011-b5a5-a6f50683365a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:20.756727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:20.758235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:20.765878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:20.766400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] PATH_INFO: `/v3/projects/b7b7680c7e114cd0b2d7ab9e9620d7a2` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:20.768219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b7680c7e114cd0b2d7ab9e9620d7a2)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:20.770440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:20.936663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b7680c7e114cd0b2d7ab9e9620d7a2', 'request_id': 'req-35042856-79b6-4cd8-af3f-16f53d58e363'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:20.999804 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:21.002662 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:21.042901 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b7680c7e114cd0b2d7ab9e9620d7a2', 'request_id': 'req-35042856-79b6-4cd8-af3f-16f53d58e363'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.056964 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b7680c7e114cd0b2d7ab9e9620d7a2', 'request_id': 'req-35042856-79b6-4cd8-af3f-16f53d58e363'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.067181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844c4d7-3ff3-45f6-abe2-68be92ce2a51 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:21.088126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] The token cache is being invalidate because project b7b7680c7e114cd0b2d7ab9e9620d7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:21.088682 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.089675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.092816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1227/2426] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:20 2022] DELETE /identity/v3/projects/b7b7680c7e114cd0b2d7ab9e9620d7a2 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:21.103504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:21.105166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:21.331597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:21.333834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:21.337247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:21.337247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] PATH_INFO: `/v3/users/000d6996c2674179874363ecd5a3ce3a` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:21.337247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000d6996c2674179874363ecd5a3ce3a)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:21.342422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:21.393877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35042856-79b6-4cd8-af3f-16f53d58e363 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:21.407334 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:21.412067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:21.412490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:21.413434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] PATH_INFO: `/v3/users/669fee18cf4543a98f029f5d8ade1ccf` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:21.418678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669fee18cf4543a98f029f5d8ade1ccf)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:21.420873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:21.803937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000d6996c2674179874363ecd5a3ce3a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.805614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669fee18cf4543a98f029f5d8ade1ccf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.808955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669fee18cf4543a98f029f5d8ade1ccf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.813466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000d6996c2674179874363ecd5a3ce3a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.849591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669fee18cf4543a98f029f5d8ade1ccf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:21.986466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000d6996c2674179874363ecd5a3ce3a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:22.012226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000d6996c2674179874363ecd5a3ce3a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:22.013388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000d6996c2674179874363ecd5a3ce3a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:22.055575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669fee18cf4543a98f029f5d8ade1ccf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:22.058327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669fee18cf4543a98f029f5d8ade1ccf'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:22.100307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1200/2427] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:20 2022] DELETE /identity/v3/users/000d6996c2674179874363ecd5a3ce3a => generated 0 bytes in 1098 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:22.107024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1228/2428] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:21 2022] DELETE /identity/v3/users/669fee18cf4543a98f029f5d8ade1ccf => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:22.909763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:22.910383 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:23.069089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2767f-0854-4347-b64b-adad4093a253 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:23.270247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:23.271155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:23.271373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:23.271946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] PATH_INFO: `/v3/projects/82f946458bc148b3aa3cbef9e59591cf` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:23.273514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f946458bc148b3aa3cbef9e59591cf)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:23.276011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:23.410569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f946458bc148b3aa3cbef9e59591cf', 'request_id': 'req-9ac959f7-9023-439d-8677-bbcca0fd0b8c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.509377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f946458bc148b3aa3cbef9e59591cf', 'request_id': 'req-9ac959f7-9023-439d-8677-bbcca0fd0b8c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.517531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f946458bc148b3aa3cbef9e59591cf', 'request_id': 'req-9ac959f7-9023-439d-8677-bbcca0fd0b8c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.530636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] The token cache is being invalidate because project 82f946458bc148b3aa3cbef9e59591cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:23.531291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.532183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.534536 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1201/2429] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:22 2022] DELETE /identity/v3/projects/82f946458bc148b3aa3cbef9e59591cf => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:23.538647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:23.540259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:23.555023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f2ef0-90c4-420c-ad41-18f02dc2a1a8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:23.566003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:23.568168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:23.690947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:23.692315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:23.693257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:23.695164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] PATH_INFO: `/v3/users/4bcbe4ee1dbf4c15a8f61fcb661452c6` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:23.700972 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac959f7-9023-439d-8677-bbcca0fd0b8c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:23.701929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bcbe4ee1dbf4c15a8f61fcb661452c6)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:23.704352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:23.708620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:23.709965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:23.710247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:23.710523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] PATH_INFO: `/v3/projects/030280dff30e4837a7eb18ab8b258461` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:23.712572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=030280dff30e4837a7eb18ab8b258461)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:23.715694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:23.958075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030280dff30e4837a7eb18ab8b258461', 'request_id': 'req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.959778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcbe4ee1dbf4c15a8f61fcb661452c6'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.960472 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcbe4ee1dbf4c15a8f61fcb661452c6'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:23.982028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcbe4ee1dbf4c15a8f61fcb661452c6'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:24.042607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030280dff30e4837a7eb18ab8b258461', 'request_id': 'req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:24.053832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030280dff30e4837a7eb18ab8b258461', 'request_id': 'req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:24.066488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] The token cache is being invalidate because project 030280dff30e4837a7eb18ab8b258461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:24.066777 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:24.067442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-42f3d45b-43a5-4bda-aa3d-8def5aa10dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:24.069080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1202/2430] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:23 2022] DELETE /identity/v3/projects/030280dff30e4837a7eb18ab8b258461 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:24.085030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa1c-005a-43aa-a46b-9b5beef98c14 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.085030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa1c-005a-43aa-a46b-9b5beef98c14 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.085030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adaa1c-005a-43aa-a46b-9b5beef98c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.094719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-78adaa1c-005a-43aa-a46b-9b5beef98c14 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:24.096177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-78adaa1c-005a-43aa-a46b-9b5beef98c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:24.168912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1203/2431] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:24.171642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcbe4ee1dbf4c15a8f61fcb661452c6'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:24.172281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcbe4ee1dbf4c15a8f61fcb661452c6'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:24.176749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e84553-32de-4645-a1db-2171de9d55cc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.177362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e84553-32de-4645-a1db-2171de9d55cc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.177857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e84553-32de-4645-a1db-2171de9d55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.197218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1229/2432] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:23 2022] DELETE /identity/v3/users/4bcbe4ee1dbf4c15a8f61fcb661452c6 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:24.215268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-23e84553-32de-4645-a1db-2171de9d55cc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:24.216810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-23e84553-32de-4645-a1db-2171de9d55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:24.307612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1204/2433] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:24.307975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:24.324761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ab3a9-711f-4cd9-98ee-6cb133428fa0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:24.331220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:24.332293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.332795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.333377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.334435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:24.334999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:24.337199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:24.358684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e84553-32de-4645-a1db-2171de9d55cc None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:24.365195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1230/2434] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:23:24.371039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e84553-32de-4645-a1db-2171de9d55cc None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:24.382934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:24.384406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.384862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.385249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.386103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:24.388221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:24.468788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1205/2435] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:24 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:24.473615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:24.493600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8c619-e030-486d-ae59-6355c3139c96 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:24.606314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:24.607198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.608072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.609305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.610262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:24.614528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:24.737385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1231/2436] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:24 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:24.741729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:24.754868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b88826-4413-45e2-9eb3-a28ebef1db7b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:24.761427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:24.762398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.763973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.763973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.764716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:24.766751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:24.785369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1206/2437] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:24.789195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:24.802830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf5301-a88f-4526-a5cb-3ad0adefbfc0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:24.809971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:24.811681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.812446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.813264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.814348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:24.819753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:24.866225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1232/2438] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:24.871600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:24.883048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3dfd9-4421-43b5-94f4-4ce9781a8842 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:24.888969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a72ee-c8c9-4222-b31e-2f14b2bd8758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:24.890024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a72ee-c8c9-4222-b31e-2f14b2bd8758 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.890669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a72ee-c8c9-4222-b31e-2f14b2bd8758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.890963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a72ee-c8c9-4222-b31e-2f14b2bd8758 admin admin] PATH_INFO: `/v3/projects/031f573b8b40415d85a6ee3bcbd466cc/users/dce01c2ae8e84653a2661296ddac7b14/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.931492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a72ee-c8c9-4222-b31e-2f14b2bd8758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031f573b8b40415d85a6ee3bcbd466cc, user_id=dce01c2ae8e84653a2661296ddac7b14, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:24.943431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a72ee-c8c9-4222-b31e-2f14b2bd8758 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:24.965911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:24.971275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:24.990319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba73ec5-2716-42ed-a516-67020fe3141a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:24.996062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:24.996928 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:24.999782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:24.999782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] PATH_INFO: `/v3/projects/8747e6aefc644642a2e24e4993a36726` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:24.999782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8747e6aefc644642a2e24e4993a36726)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:25.001468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:25.028109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1207/2439] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:24 2022] PUT /identity/v3/projects/031f573b8b40415d85a6ee3bcbd466cc/users/dce01c2ae8e84653a2661296ddac7b14/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:25.038700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.039294 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.039579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.079362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] MFA Rules not processed for user `dce01c2ae8e84653a2661296ddac7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:25.080213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:25.169784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1208/2440] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:25.176634 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:25.178543 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:25.204809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8747e6aefc644642a2e24e4993a36726', 'request_id': 'req-6303cc23-20ac-480f-b9a8-d478caea9aa8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:25.290965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b4a2-65ab-4137-a4fe-367e50674764 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:25.293539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8747e6aefc644642a2e24e4993a36726', 'request_id': 'req-6303cc23-20ac-480f-b9a8-d478caea9aa8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:25.302499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8747e6aefc644642a2e24e4993a36726', 'request_id': 'req-6303cc23-20ac-480f-b9a8-d478caea9aa8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:25.317031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] The token cache is being invalidate because project 8747e6aefc644642a2e24e4993a36726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:25.317437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:25.318024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6303cc23-20ac-480f-b9a8-d478caea9aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:25.320085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1233/2441] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:24 2022] DELETE /identity/v3/projects/8747e6aefc644642a2e24e4993a36726 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:25.326990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65348088-3212-4c75-a47d-b1f266d9d437 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.327287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65348088-3212-4c75-a47d-b1f266d9d437 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.330737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65348088-3212-4c75-a47d-b1f266d9d437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.348813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-65348088-3212-4c75-a47d-b1f266d9d437 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:25.350117 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-65348088-3212-4c75-a47d-b1f266d9d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:25.358369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:25.359636 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.360117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.360916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.365774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:25.470375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:25.472245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:25.483568 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1209/2442] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:23:25.506471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:25.508162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:25.608818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f356f5-8f35-4843-9fa8-9729a0dff8f0 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:25.614566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:25.615798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.616087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.616912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] PATH_INFO: `/v3/users/dce01c2ae8e84653a2661296ddac7b14` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.618796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce01c2ae8e84653a2661296ddac7b14)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:25.620916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:25.626603 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1234/2443] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:25.634949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c53e9a-1d2d-4376-9a27-969fc7edb16f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.635247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c53e9a-1d2d-4376-9a27-969fc7edb16f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.635583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c53e9a-1d2d-4376-9a27-969fc7edb16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.654431 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-04c53e9a-1d2d-4376-9a27-969fc7edb16f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:25.656131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-04c53e9a-1d2d-4376-9a27-969fc7edb16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:25.663904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1235/2444] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:25.667845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c53e9a-1d2d-4376-9a27-969fc7edb16f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:25.677013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c53e9a-1d2d-4376-9a27-969fc7edb16f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:25.682424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:25.683099 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.683384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.683668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.684416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:25.684728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:25.686606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:25.700846 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1236/2445] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:23:25.703874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:25.714228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133426f9-b623-4eba-a40e-d7b027806cb6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:25.718942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:25.719484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.719765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.720065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.720825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:25.722775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:25.898391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1237/2446] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:25 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:25.901446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:25.916166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce01c2ae8e84653a2661296ddac7b14'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:25.918020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce01c2ae8e84653a2661296ddac7b14'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:25.975550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764e3d-c12a-471b-a5c3-6812f9db85a8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:25.982093 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:25.982841 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:25.983134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:25.983414 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:25.984224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:25.986451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:26.026527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce01c2ae8e84653a2661296ddac7b14'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:26.039423 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce01c2ae8e84653a2661296ddac7b14'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:26.040144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d83418f-4506-4370-8a8a-d29997fd8e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce01c2ae8e84653a2661296ddac7b14'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:26.056687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1210/2447] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:25 2022] DELETE /identity/v3/users/dce01c2ae8e84653a2661296ddac7b14 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:26.058171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.058649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.058940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.078791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:26.080389 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:26.101465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1238/2448] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:25 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:26.105663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:26.108167 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:26.135038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6709b6-eef9-4453-8281-d391b65dc157 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:26.195151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1211/2449] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:26.205770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:26.207763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:26.211105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:26.212657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.213112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.213925 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.214749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:26.216516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:26.228981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1239/2450] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:26.234285 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:26.250036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b3bff-d041-4e82-b708-52b09b7a1acf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:26.255818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:26.256548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.256700 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.260556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.260556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:26.262332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:26.283351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1240/2451] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:26.288168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:26.303161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd0f03-4c55-4b4a-b21c-8ce095f123cc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:26.313320 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:26.314816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.315912 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.316031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ce19-e46b-42ae-9b26-6cc0405e8a7b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:26.316582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] PATH_INFO: `/v3/projects/3c3683e54a5841629ca2c5fb0ef68738/users/c16ef1b73b5140deb5263b01969b2d48/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.323466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d290d-e811-4e0e-aa82-04dd5bb6f2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:26.323875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d290d-e811-4e0e-aa82-04dd5bb6f2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.324591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d290d-e811-4e0e-aa82-04dd5bb6f2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.324591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d290d-e811-4e0e-aa82-04dd5bb6f2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.335930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d290d-e811-4e0e-aa82-04dd5bb6f2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:26.337460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d290d-e811-4e0e-aa82-04dd5bb6f2d8 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:26.339878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3683e54a5841629ca2c5fb0ef68738, user_id=c16ef1b73b5140deb5263b01969b2d48, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:26.343695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:26.349535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1212/2452] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:26.452617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1241/2453] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:26 2022] PUT /identity/v3/projects/3c3683e54a5841629ca2c5fb0ef68738/users/c16ef1b73b5140deb5263b01969b2d48/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:26.454559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.454852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.455149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.489457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] MFA Rules not processed for user `c16ef1b73b5140deb5263b01969b2d48`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:26.490729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:26.592199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1213/2454] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:26.602157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:26.605761 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:26.716932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f60d3-5b36-4cfd-b941-1d0fef2033e6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:26.721176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a89cd-c037-444b-852d-f6080ee8c38d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:26.721927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a89cd-c037-444b-852d-f6080ee8c38d service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.722213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a89cd-c037-444b-852d-f6080ee8c38d service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.722485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a89cd-c037-444b-852d-f6080ee8c38d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.735397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a89cd-c037-444b-852d-f6080ee8c38d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:26.736924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a89cd-c037-444b-852d-f6080ee8c38d service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:26.747971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1242/2455] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:26.840281 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:26.841871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:26.967331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acfc88-46f6-4a9e-ac56-769e038a71b4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:26.976045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:26.977029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:26.977933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:26.979129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] PATH_INFO: `/v3/projects/031f573b8b40415d85a6ee3bcbd466cc` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:26.979984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031f573b8b40415d85a6ee3bcbd466cc)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:26.982587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:27.131416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031f573b8b40415d85a6ee3bcbd466cc', 'request_id': 'req-817ca165-6dba-4d6b-95ef-de1885e6eb43'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:27.215109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1249e4-8df0-49b0-8159-75014b731ab7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.215817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1249e4-8df0-49b0-8159-75014b731ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.216308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1249e4-8df0-49b0-8159-75014b731ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.219610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031f573b8b40415d85a6ee3bcbd466cc', 'request_id': 'req-817ca165-6dba-4d6b-95ef-de1885e6eb43'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:27.229503 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031f573b8b40415d85a6ee3bcbd466cc', 'request_id': 'req-817ca165-6dba-4d6b-95ef-de1885e6eb43'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:27.244489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] The token cache is being invalidate because project 031f573b8b40415d85a6ee3bcbd466cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:27.244962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:27.245768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-817ca165-6dba-4d6b-95ef-de1885e6eb43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:27.247786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1214/2456] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:26 2022] DELETE /identity/v3/projects/031f573b8b40415d85a6ee3bcbd466cc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:27.252400 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.252757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.253117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.269516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-aa1249e4-8df0-49b0-8159-75014b731ab7 None None] MFA Rules not processed for user `4a5cac73601b499c9963d1adfbf2cd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:27.270854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-aa1249e4-8df0-49b0-8159-75014b731ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:27.293398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:27.294703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:27.400880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1243/2457] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:27.406574 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1215/2458] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:27.407635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb00f0-f926-4fba-85fb-c78c2ab5ba56 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.407897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb00f0-f926-4fba-85fb-c78c2ab5ba56 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.408179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb00f0-f926-4fba-85fb-c78c2ab5ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.413175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:27.414920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:27.431657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6cbb00f0-f926-4fba-85fb-c78c2ab5ba56 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:27.435348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6cbb00f0-f926-4fba-85fb-c78c2ab5ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:27.463119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1244/2459] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:27.472987 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb00f0-f926-4fba-85fb-c78c2ab5ba56 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:27.482455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb00f0-f926-4fba-85fb-c78c2ab5ba56 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:27.492552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:27.492552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.492552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.492552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.493070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:27.493070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:27.493070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:27.508241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1245/2460] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:23:27.513154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:27.538187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb202be-d901-47ee-8da6-01084cf156f5 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:27.542320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fb7c-bf3c-48f6-94da-468355883bb6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:27.552654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:27.552654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.552654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.552654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.553016 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:27.553016 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:27.553148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:27.553148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.553148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.553148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.553452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:27.616360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:27.618485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:27.629674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1216/2461] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:27.651715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1246/2462] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:27 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:27.656508 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:27.673853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526e631-8d21-46df-90ca-957f569686f5 service nova] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:27.748720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:27.749745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.753658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.753658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.753658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:27.753658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:27.886308 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1217/2463] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:27 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:27.887652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:27.897548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada89b-babb-4abf-b977-cc9c96dd81fb admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:27.904809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:27.905680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.905985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.914356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.914356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:27.914356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:27.923963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1247/2464] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:27.924810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:27.935748 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8b4f1-49e2-43a8-98a0-a021d38ae7f1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:27.941375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90addd55-c3d2-4b9a-9c52-8e43b6e27dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:27.942028 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90addd55-c3d2-4b9a-9c52-8e43b6e27dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.942382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90addd55-c3d2-4b9a-9c52-8e43b6e27dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.943232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90addd55-c3d2-4b9a-9c52-8e43b6e27dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.943606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90addd55-c3d2-4b9a-9c52-8e43b6e27dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:27.945201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90addd55-c3d2-4b9a-9c52-8e43b6e27dcd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:27.956552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1218/2465] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:23:27.960562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:27.970376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c92a-9b65-4ba3-955c-01ad5fa38ca1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:27.975396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:27.976322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:27.976840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:27.976840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] PATH_INFO: `/v3/projects/dab62afaabe44ab5ba3ab832b2d6ad3e/users/94286cd5d5084c6b9166dece6dd30147/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:27.993660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab62afaabe44ab5ba3ab832b2d6ad3e, user_id=94286cd5d5084c6b9166dece6dd30147, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:27.996309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:28.088813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1248/2466] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:27 2022] PUT /identity/v3/projects/dab62afaabe44ab5ba3ab832b2d6ad3e/users/94286cd5d5084c6b9166dece6dd30147/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:23:28.099045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58de83-2212-4b8d-92ca-642e947be8ab None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:28.099331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58de83-2212-4b8d-92ca-642e947be8ab None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:28.099609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58de83-2212-4b8d-92ca-642e947be8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:28.129250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-cf58de83-2212-4b8d-92ca-642e947be8ab None None] MFA Rules not processed for user `94286cd5d5084c6b9166dece6dd30147`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:28.130579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cf58de83-2212-4b8d-92ca-642e947be8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:28.264899 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1219/2467] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:28.269705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:28.344297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa37b8-dc43-4e13-9d60-ce289743e6f3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:28.349093 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:28.349780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:28.350062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:28.350336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:28.351039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:28.353518 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:28.427931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722276-3ad9-497d-a9ae-02f30843ef96 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:28.427931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722276-3ad9-497d-a9ae-02f30843ef96 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:28.427931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722276-3ad9-497d-a9ae-02f30843ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:28.443421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-05722276-3ad9-497d-a9ae-02f30843ef96 None None] MFA Rules not processed for user `86560704b2374f75bc32b19475b63462`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:28.444905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-05722276-3ad9-497d-a9ae-02f30843ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:28.454321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1249/2468] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:28 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:28.458452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:28.508161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1220/2469] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:28.526643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162785-b072-431e-8523-8057c0ddf251 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:28.531656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:28.532466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:28.532808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:28.533200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:28.534061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:28.536835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:28.664314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1250/2470] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:28 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:23:28.666251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722276-3ad9-497d-a9ae-02f30843ef96 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:28.687820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722276-3ad9-497d-a9ae-02f30843ef96 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:28.695858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:28.696624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:28.696969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:28.697385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:28.698467 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:28.700364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:28.718797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1221/2471] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:28.720186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:28.735506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd875-6e76-4744-a1f1-e168b58a3a61 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:28.746145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:28.747210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:28.747555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:28.747894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] PATH_INFO: `/v3/projects/525fb7f58a4c462fa2eca76b9c6b6b49/users/4f45fd7b9bca493f983b67400a0ccc85/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:28.765367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=525fb7f58a4c462fa2eca76b9c6b6b49, user_id=4f45fd7b9bca493f983b67400a0ccc85, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:28.768223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:28.886725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1251/2472] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:28 2022] PUT /identity/v3/projects/525fb7f58a4c462fa2eca76b9c6b6b49/users/4f45fd7b9bca493f983b67400a0ccc85/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:28.890702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:28.902220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a249d7-d712-40bb-8285-ef83718cd75d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:28.996094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ab939-ab16-4c25-936b-88b7ddd828ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:28.997791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ab939-ab16-4c25-936b-88b7ddd828ab admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:28.998154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ab939-ab16-4c25-936b-88b7ddd828ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:28.998521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ab939-ab16-4c25-936b-88b7ddd828ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:28.999817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ab939-ab16-4c25-936b-88b7ddd828ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:29.001698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ab939-ab16-4c25-936b-88b7ddd828ab admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:29.019247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1222/2473] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:29.020676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:29.034849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d433-0faa-4e9b-ae19-2f85f747e65c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:29.043162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:29.044257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:29.044542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:29.044878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] PATH_INFO: `/v3/projects/525fb7f58a4c462fa2eca76b9c6b6b49/users/4f45fd7b9bca493f983b67400a0ccc85/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:29.047534 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=525fb7f58a4c462fa2eca76b9c6b6b49, user_id=4f45fd7b9bca493f983b67400a0ccc85, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:29.051580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:29.063006 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1252/2474] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:29 2022] PUT /identity/v3/projects/525fb7f58a4c462fa2eca76b9c6b6b49/users/4f45fd7b9bca493f983b67400a0ccc85/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:29.075263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ee4a-9c1d-4ac3-b64d-af98068ce120 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:29.075751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ee4a-9c1d-4ac3-b64d-af98068ce120 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:29.076137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ee4a-9c1d-4ac3-b64d-af98068ce120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:29.103883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-cff6ee4a-9c1d-4ac3-b64d-af98068ce120 None None] MFA Rules not processed for user `4f45fd7b9bca493f983b67400a0ccc85`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:29.105182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cff6ee4a-9c1d-4ac3-b64d-af98068ce120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:29.190790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1223/2475] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:29.209971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:29.212384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:29.287292 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ef8f9-d055-4ece-b16f-2a5d15a0b86e admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:29.291267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:29.292020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:29.292200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:29.292482 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:29.347629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:29.349082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:29.359517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1253/2476] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:31.113889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358300-50f8-45ea-a10c-ea19288882d3 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:31.115167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358300-50f8-45ea-a10c-ea19288882d3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:31.115167 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358300-50f8-45ea-a10c-ea19288882d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:31.136258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c9358300-50f8-45ea-a10c-ea19288882d3 None None] MFA Rules not processed for user `489271f8dc5a432792bea8521abf5eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:31.137761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c9358300-50f8-45ea-a10c-ea19288882d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:31.201977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1224/2477] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:23:40.233506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:40.298679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880269-9f60-43a7-aa40-d0e13cce7449 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:40.305812 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222f59-0891-421b-915c-095b267630db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:40.307661 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222f59-0891-421b-915c-095b267630db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:40.307948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222f59-0891-421b-915c-095b267630db admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:40.308224 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222f59-0891-421b-915c-095b267630db admin admin] PATH_INFO: `/v3/users/94286cd5d5084c6b9166dece6dd30147` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:40.309522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d222f59-0891-421b-915c-095b267630db admin admin] RBAC: Authorizing `identity:delete_user(user_id=94286cd5d5084c6b9166dece6dd30147)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:40.311428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d222f59-0891-421b-915c-095b267630db admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:40.511352 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94286cd5d5084c6b9166dece6dd30147'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:40.511945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94286cd5d5084c6b9166dece6dd30147'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:40.525524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94286cd5d5084c6b9166dece6dd30147'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:40.602545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94286cd5d5084c6b9166dece6dd30147'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:40.603797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94286cd5d5084c6b9166dece6dd30147'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:40.619794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1254/2478] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:40 2022] DELETE /identity/v3/users/94286cd5d5084c6b9166dece6dd30147 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:40.624323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:40.624822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:40.624917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:40.642349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:40.643623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:40.704852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1225/2479] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:40.715264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:40.719152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:40.777602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222f59-0891-421b-915c-095b267630db admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:40.781373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:40.782354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:40.782648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:40.782949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:40.793049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:40.794514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:40.804008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1255/2480] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:23:41.294415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:41.295368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:41.307921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fd1ef-82c3-4fe2-9c77-2138bddabb82 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:41.313103 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:41.313993 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:41.314279 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:41.314556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] PATH_INFO: `/v3/projects/dab62afaabe44ab5ba3ab832b2d6ad3e` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:41.315992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab62afaabe44ab5ba3ab832b2d6ad3e)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:41.318012 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:41.442664 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab62afaabe44ab5ba3ab832b2d6ad3e', 'request_id': 'req-6e74e2de-aaa2-4be3-85cf-752ecf165fde'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:41.510820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab62afaabe44ab5ba3ab832b2d6ad3e', 'request_id': 'req-6e74e2de-aaa2-4be3-85cf-752ecf165fde'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:41.517854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab62afaabe44ab5ba3ab832b2d6ad3e', 'request_id': 'req-6e74e2de-aaa2-4be3-85cf-752ecf165fde'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:41.529074 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] The token cache is being invalidate because project dab62afaabe44ab5ba3ab832b2d6ad3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:41.529396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:41.530043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:41.531805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1226/2481] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:41 2022] DELETE /identity/v3/projects/dab62afaabe44ab5ba3ab832b2d6ad3e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:41.536929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:41.551992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a917e4-cce5-408c-acc0-311321aa5ea7 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:41.623013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:41.624029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:41.624372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:41.624648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] PATH_INFO: `/v3/users/4f45fd7b9bca493f983b67400a0ccc85` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:41.625879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f45fd7b9bca493f983b67400a0ccc85)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:41.627856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:42.224757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f45fd7b9bca493f983b67400a0ccc85'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:42.225506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f45fd7b9bca493f983b67400a0ccc85'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:42.241114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f45fd7b9bca493f983b67400a0ccc85'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:42.328057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f45fd7b9bca493f983b67400a0ccc85'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:42.328677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-042dff0f-5aa9-4e58-94d5-2ee712c3e75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f45fd7b9bca493f983b67400a0ccc85'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:42.343059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1256/2482] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:41 2022] DELETE /identity/v3/users/4f45fd7b9bca493f983b67400a0ccc85 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:42.827869 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:42.830060 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:42.846356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e2de-aaa2-4be3-85cf-752ecf165fde admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:42.916817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:42.917687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:42.917971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:42.918253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] PATH_INFO: `/v3/projects/525fb7f58a4c462fa2eca76b9c6b6b49` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:42.919791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525fb7f58a4c462fa2eca76b9c6b6b49)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:42.921890 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:43.070794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525fb7f58a4c462fa2eca76b9c6b6b49', 'request_id': 'req-32bc25fb-34f5-447b-ab01-427ab3fec571'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:43.156765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525fb7f58a4c462fa2eca76b9c6b6b49', 'request_id': 'req-32bc25fb-34f5-447b-ab01-427ab3fec571'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:43.163515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525fb7f58a4c462fa2eca76b9c6b6b49', 'request_id': 'req-32bc25fb-34f5-447b-ab01-427ab3fec571'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:43.174843 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] The token cache is being invalidate because project 525fb7f58a4c462fa2eca76b9c6b6b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:43.175157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:43.175939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-32bc25fb-34f5-447b-ab01-427ab3fec571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:43.178027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1227/2483] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:42 2022] DELETE /identity/v3/projects/525fb7f58a4c462fa2eca76b9c6b6b49 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:43.185116 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506724e5-7a47-45aa-bfd5-c5c50f473465 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.186720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506724e5-7a47-45aa-bfd5-c5c50f473465 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.187011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506724e5-7a47-45aa-bfd5-c5c50f473465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.205563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-506724e5-7a47-45aa-bfd5-c5c50f473465 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:43.206833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-506724e5-7a47-45aa-bfd5-c5c50f473465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:43.272262 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1257/2484] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:43.281452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c688b3-fc39-4799-89c7-76af58e7bc39 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.281742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c688b3-fc39-4799-89c7-76af58e7bc39 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.282357 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c688b3-fc39-4799-89c7-76af58e7bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.307879 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-86c688b3-fc39-4799-89c7-76af58e7bc39 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:43.309295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-86c688b3-fc39-4799-89c7-76af58e7bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:43.322362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1228/2485] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:43.328307 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506724e5-7a47-45aa-bfd5-c5c50f473465 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:43.338796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506724e5-7a47-45aa-bfd5-c5c50f473465 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:43.344555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:43.345412 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.346019 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.346411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.347368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:43.347962 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:43.350360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:43.363068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1258/2486] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:23:43.372492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c688b3-fc39-4799-89c7-76af58e7bc39 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:43.378569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c688b3-fc39-4799-89c7-76af58e7bc39 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:43.383684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:43.384620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.385157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.385466 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.386797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:43.388195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:43.471430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1229/2487] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:43 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:43.475435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:43.487504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2563b-3145-4fc7-9589-e53b380e3a63 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:43.568423 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:43.569552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.569839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.570118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.570837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:43.573236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:43.700718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1259/2488] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:43 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:43.704887 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:43.717629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b90af-e549-4b05-83ee-b5897f5b9269 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:43.726653 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:43.727379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.727735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.728005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.728838 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:43.730538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:43.745334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1230/2489] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:23:43.749046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:43.758988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c399f-b324-4a18-a1f6-a98b7ae46075 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:43.764127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a66b-c37d-446f-9ed6-840f25239e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:43.764764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a66b-c37d-446f-9ed6-840f25239e15 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.765044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a66b-c37d-446f-9ed6-840f25239e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.765350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a66b-c37d-446f-9ed6-840f25239e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.766121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a66b-c37d-446f-9ed6-840f25239e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:43.767681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a66b-c37d-446f-9ed6-840f25239e15 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:43.778698 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1260/2490] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:43.782990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:43.792924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc557-fe1d-4b76-a1b2-b325500fe7a2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:43.797497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:43.798365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.798649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.798927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] PATH_INFO: `/v3/projects/014280e5cea64e0aaaa1ca4a06ca7f4d/users/88db787357de4e0e804c432e341f83ce/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.815566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014280e5cea64e0aaaa1ca4a06ca7f4d, user_id=88db787357de4e0e804c432e341f83ce, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:43.818357 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:43.935990 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1231/2491] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:43 2022] PUT /identity/v3/projects/014280e5cea64e0aaaa1ca4a06ca7f4d/users/88db787357de4e0e804c432e341f83ce/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:43.946153 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed9fc7-50f8-4b8e-9cf1-ed6314d79fd4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:43.946435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed9fc7-50f8-4b8e-9cf1-ed6314d79fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:43.946708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed9fc7-50f8-4b8e-9cf1-ed6314d79fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:43.974709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c6ed9fc7-50f8-4b8e-9cf1-ed6314d79fd4 None None] MFA Rules not processed for user `88db787357de4e0e804c432e341f83ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:43.975909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c6ed9fc7-50f8-4b8e-9cf1-ed6314d79fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:44.038516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1261/2492] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:44.048452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:44.053704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:44.111017 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105132-b18e-428c-b0f5-2695f296b032 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:44.114900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:44.115539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:44.115828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:44.116107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:44.125652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:44.127285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:44.137379 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1232/2493] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:53.417033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed9fc7-50f8-4b8e-9cf1-ed6314d79fd4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:53.426797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed9fc7-50f8-4b8e-9cf1-ed6314d79fd4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:53.430616 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:53.435992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:53.435992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:53.435992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:53.435992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:53.510800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:53.512786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:53.523520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1262/2494] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:54.571753 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:54.573831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:54.654196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c65941-eb40-4d10-a68c-a2ac9bdc319f service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:54.658683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e95a-c7e7-4776-ac97-c432e4eeeae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:54.659352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e95a-c7e7-4776-ac97-c432e4eeeae1 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:54.659633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e95a-c7e7-4776-ac97-c432e4eeeae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:54.659906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e95a-c7e7-4776-ac97-c432e4eeeae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:54.661992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1801e95a-c7e7-4776-ac97-c432e4eeeae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:54.680949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e95a-c7e7-4776-ac97-c432e4eeeae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:54.688871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e95a-c7e7-4776-ac97-c432e4eeeae1 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:54.696322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1233/2495] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:57.103853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:57.105897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:57.177963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ec155-cc11-4368-addd-d7fed871bd4b service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:57.182859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:57.183927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:57.185066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:57.185504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] PATH_INFO: `/v3/users/c16ef1b73b5140deb5263b01969b2d48` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:57.187123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16ef1b73b5140deb5263b01969b2d48)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:57.189259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:57.391929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16ef1b73b5140deb5263b01969b2d48'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:57.392771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16ef1b73b5140deb5263b01969b2d48'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:57.405590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16ef1b73b5140deb5263b01969b2d48'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:57.516719 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16ef1b73b5140deb5263b01969b2d48'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:57.517766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16ef1b73b5140deb5263b01969b2d48'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:57.532282 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1263/2496] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:57 2022] DELETE /identity/v3/users/c16ef1b73b5140deb5263b01969b2d48 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:57.536288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:57.536725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:57.536820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:57.555113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:57.556511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:57.618174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1234/2497] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:57.626844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:57.629211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:57.686751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9f37-402d-4894-906f-fd72e9293c09 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:57.690259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c2efe-ef46-4c6e-ad31-bfcbec76d5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:57.690903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2efe-ef46-4c6e-ad31-bfcbec76d5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:57.691185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2efe-ef46-4c6e-ad31-bfcbec76d5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:57.691455 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c2efe-ef46-4c6e-ad31-bfcbec76d5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:57.704378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c2efe-ef46-4c6e-ad31-bfcbec76d5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:57.704378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c2efe-ef46-4c6e-ad31-bfcbec76d5c7 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:57.714164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1264/2498] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:23:58.270193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:58.271865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:58.304896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd616f74-be63-4415-a29b-7826541dca0b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:58.310938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:58.311945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:58.312313 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:58.312648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] PATH_INFO: `/v3/projects/3c3683e54a5841629ca2c5fb0ef68738` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:58.314031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3683e54a5841629ca2c5fb0ef68738)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:58.316618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:58.478604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3683e54a5841629ca2c5fb0ef68738', 'request_id': 'req-19cce912-bc50-4bd9-9cc6-36794442ad05'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:58.584956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3683e54a5841629ca2c5fb0ef68738', 'request_id': 'req-19cce912-bc50-4bd9-9cc6-36794442ad05'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:58.593865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3683e54a5841629ca2c5fb0ef68738', 'request_id': 'req-19cce912-bc50-4bd9-9cc6-36794442ad05'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:58.605981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] The token cache is being invalidate because project 3c3683e54a5841629ca2c5fb0ef68738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:23:58.606417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:58.607271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-19cce912-bc50-4bd9-9cc6-36794442ad05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:58.609124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1235/2499] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:23:58 2022] DELETE /identity/v3/projects/3c3683e54a5841629ca2c5fb0ef68738 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:58.619891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59005862-6360-45b7-a41a-492e283edb07 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:58.620378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59005862-6360-45b7-a41a-492e283edb07 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:58.620541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59005862-6360-45b7-a41a-492e283edb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:58.640553 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-59005862-6360-45b7-a41a-492e283edb07 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:58.642191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-59005862-6360-45b7-a41a-492e283edb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:58.701374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1265/2500] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:58.709540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c0d1-3df5-4da8-a438-b2f8bfdc4098 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:58.709898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c0d1-3df5-4da8-a438-b2f8bfdc4098 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:58.710280 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c0d1-3df5-4da8-a438-b2f8bfdc4098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:58.732241 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-a174c0d1-3df5-4da8-a438-b2f8bfdc4098 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:58.736703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a174c0d1-3df5-4da8-a438-b2f8bfdc4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:58.741896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1236/2501] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:58.746668 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59005862-6360-45b7-a41a-492e283edb07 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:58.756367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59005862-6360-45b7-a41a-492e283edb07 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:58.761082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:58.762486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:58.762763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:58.763031 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:58.763792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:23:58.764092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:58.765755 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:58.777524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1266/2502] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:23:58.781798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174c0d1-3df5-4da8-a438-b2f8bfdc4098 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:58.790865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174c0d1-3df5-4da8-a438-b2f8bfdc4098 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:58.800413 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:58.801065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:58.801505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:58.801784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:58.802486 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:58.804500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:58.946836 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1237/2503] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:58 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:58.951576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:58.965957 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc556ac-d5db-445f-af8d-0054b59b8d9a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:59.041803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:59.042530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.043353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.043637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.044347 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:59.046321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:59.192485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1267/2504] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:58 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:59.196582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:59.213211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd3a5e-6b2c-4fcb-b2ab-69999da8768f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:59.218775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:59.219525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.220087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.220431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.221255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:59.223034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:59.241228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1238/2505] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:59.242811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:59.263373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f842-9ec1-4d20-b3f8-5a72774683f6 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:59.272085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8789571-f2dd-4a7f-a493-fe8d72f72663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:59.272842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789571-f2dd-4a7f-a493-fe8d72f72663 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.273137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789571-f2dd-4a7f-a493-fe8d72f72663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.273530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8789571-f2dd-4a7f-a493-fe8d72f72663 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.274210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8789571-f2dd-4a7f-a493-fe8d72f72663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:59.289104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8789571-f2dd-4a7f-a493-fe8d72f72663 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:59.301929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1268/2506] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:23:59.304688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:59.316251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39ce7-3f62-4a1c-8f4f-9f75cad7c97d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:59.321002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:59.321851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.322127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.322398 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] PATH_INFO: `/v3/projects/15d8804876fd43e58a5a49462e5c615f/users/cdc46f0e332b428c87142e01e8729ae2/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.342344 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d8804876fd43e58a5a49462e5c615f, user_id=cdc46f0e332b428c87142e01e8729ae2, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:59.346287 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:59.466585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1239/2507] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:23:59 2022] PUT /identity/v3/projects/15d8804876fd43e58a5a49462e5c615f/users/cdc46f0e332b428c87142e01e8729ae2/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:23:59.476535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.476898 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.477176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.506232 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] MFA Rules not processed for user `cdc46f0e332b428c87142e01e8729ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:23:59.507502 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:59.573569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1269/2508] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:23:59.578572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:59.631222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:59.632778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:23:59.645446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe0c6-ec71-47b5-960e-c0fd33266e8a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:59.650659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:59.651316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.651599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.651871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.653205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:59.655202 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:59.699625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e80a-b0d8-4f18-9887-028b05a0cc44 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:59.704400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:59.705201 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.705507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.705781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] PATH_INFO: `/v3/users/88db787357de4e0e804c432e341f83ce` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.707105 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88db787357de4e0e804c432e341f83ce)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:59.708991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:23:59.899813 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1240/2509] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:23:59 2022] POST /identity/v3/projects => generated 385 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:23:59.901151 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:23:59.904389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88db787357de4e0e804c432e341f83ce'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:59.905097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88db787357de4e0e804c432e341f83ce'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:59.918947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88db787357de4e0e804c432e341f83ce'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:23:59.970082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393e264-fd84-437e-b3bb-94ba5488d166 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:23:59.974998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:23:59.975652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:23:59.975935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:23:59.976213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:23:59.976912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:23:59.978905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.002211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88db787357de4e0e804c432e341f83ce'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:00.002890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7802c938-339f-4ec9-9ba0-e94aed0757e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88db787357de4e0e804c432e341f83ce'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:00.016106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1270/2510] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:23:59 2022] DELETE /identity/v3/users/88db787357de4e0e804c432e341f83ce => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:00.020469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.020855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.021169 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.042577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:00.043871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:00.093263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1241/2511] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:23:59 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:24:00.100263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.102211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:00.115788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1271/2512] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:24:00.125095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d123a-84d1-4a3f-924f-323663f3ef27 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.125451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.126860 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:00.131177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.131900 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.132184 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.132457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.133226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.135110 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.151246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1242/2513] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:24:00.152377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.161893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc6b25-06d7-4145-8724-6f765f20b5d7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.167087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.167976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.168261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.168539 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.169269 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.170905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.182401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1243/2514] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:24:00.186265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081d0b1-699a-4309-ba95-43d9cfa95ba3 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.187155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.189806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09f570-d599-45b4-907a-0767e54156ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.190452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09f570-d599-45b4-907a-0767e54156ef service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.192079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09f570-d599-45b4-907a-0767e54156ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.192079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09f570-d599-45b4-907a-0767e54156ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.196971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67efb1-12c0-4f7b-9a92-c76629193e40 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.201199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09f570-d599-45b4-907a-0767e54156ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.202401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.202658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09f570-d599-45b4-907a-0767e54156ef service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.203327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.203614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.203894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] PATH_INFO: `/v3/projects/f8acd4448cc9463aada96d91a6110e75/users/f9a2fdff013346d5bfd9e33f4d95f223/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.211968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1272/2515] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:24:00.221183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8acd4448cc9463aada96d91a6110e75, user_id=f9a2fdff013346d5bfd9e33f4d95f223, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.223940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.322137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1244/2516] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:24:00 2022] PUT /identity/v3/projects/f8acd4448cc9463aada96d91a6110e75/users/f9a2fdff013346d5bfd9e33f4d95f223/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:00.337718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d79a5-226a-4d48-83c7-df9ff8a90234 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.338196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d79a5-226a-4d48-83c7-df9ff8a90234 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.338504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d79a5-226a-4d48-83c7-df9ff8a90234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.365387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e43d79a5-226a-4d48-83c7-df9ff8a90234 None None] MFA Rules not processed for user `f9a2fdff013346d5bfd9e33f4d95f223`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:00.366696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e43d79a5-226a-4d48-83c7-df9ff8a90234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:00.444569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1273/2517] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:24:00.449108 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.529429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336f961-c339-4932-a472-45647cac18ed admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.534397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.535052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.535334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.535614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.536316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.538255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.649146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1245/2518] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:24:00 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:24:00.653839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d79a5-226a-4d48-83c7-df9ff8a90234 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.664329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d79a5-226a-4d48-83c7-df9ff8a90234 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.686261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.687988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:00.729182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.729882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.730345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.730625 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.731357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.745145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.753124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86460dc3-ad9a-4d6d-8dbb-fb53105f6089 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.758006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.758854 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.759133 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.759405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] PATH_INFO: `/v3/projects/014280e5cea64e0aaaa1ca4a06ca7f4d` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.760853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=014280e5cea64e0aaaa1ca4a06ca7f4d)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.763161 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.816620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1274/2519] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:24:00 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:24:00.820527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.830939 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c8754-fee2-4415-ab24-1425fc6cc4b3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.835544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.836163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.836479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.836748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.837486 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.842049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.848617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1275/2520] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:24:00.852427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:00.861746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79983-16a2-40b4-8732-2171b4b3226d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:00.866736 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:00.871340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:00.871340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:00.871340 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] PATH_INFO: `/v3/projects/76abb2dedaa0472aa9ae5f5d6d2aad4b/users/4633fe82f840475083533b1e67a6dbef/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:00.880346 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014280e5cea64e0aaaa1ca4a06ca7f4d', 'request_id': 'req-8a18bbf1-f42a-44db-acff-95fe4761d0c6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:00.883490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76abb2dedaa0472aa9ae5f5d6d2aad4b, user_id=4633fe82f840475083533b1e67a6dbef, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:00.886289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:00.979286 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014280e5cea64e0aaaa1ca4a06ca7f4d', 'request_id': 'req-8a18bbf1-f42a-44db-acff-95fe4761d0c6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:00.986145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014280e5cea64e0aaaa1ca4a06ca7f4d', 'request_id': 'req-8a18bbf1-f42a-44db-acff-95fe4761d0c6'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:00.996641 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] The token cache is being invalidate because project 014280e5cea64e0aaaa1ca4a06ca7f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:24:00.996930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:00.997588 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:00.999159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1246/2521] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:24:00 2022] DELETE /identity/v3/projects/014280e5cea64e0aaaa1ca4a06ca7f4d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:01.032345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1276/2522] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:24:00 2022] PUT /identity/v3/projects/76abb2dedaa0472aa9ae5f5d6d2aad4b/users/4633fe82f840475083533b1e67a6dbef/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:01.043247 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:01.044914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:01.116316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18bbf1-f42a-44db-acff-95fe4761d0c6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:01.180121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542bfd-c5dc-42ef-92cd-f8eeaeebd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:01.181742 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542bfd-c5dc-42ef-92cd-f8eeaeebd7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:01.182224 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542bfd-c5dc-42ef-92cd-f8eeaeebd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:01.182694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542bfd-c5dc-42ef-92cd-f8eeaeebd7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:01.184121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542bfd-c5dc-42ef-92cd-f8eeaeebd7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:01.185977 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542bfd-c5dc-42ef-92cd-f8eeaeebd7b7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:01.196622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1247/2523] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:24:01.201627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:01.213430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb9399-6d2d-49d9-8932-2d4381f6acd7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:01.218497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:01.219384 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:01.219665 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:01.219938 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] PATH_INFO: `/v3/projects/76abb2dedaa0472aa9ae5f5d6d2aad4b/users/4633fe82f840475083533b1e67a6dbef/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:01.221958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76abb2dedaa0472aa9ae5f5d6d2aad4b, user_id=4633fe82f840475083533b1e67a6dbef, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:01.224703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:01.236011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1277/2524] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:24:01 2022] PUT /identity/v3/projects/76abb2dedaa0472aa9ae5f5d6d2aad4b/users/4633fe82f840475083533b1e67a6dbef/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:01.254146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3642e-a1f2-4a3d-a48e-6677dd66417a None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:01.254433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3642e-a1f2-4a3d-a48e-6677dd66417a None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:01.254706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3642e-a1f2-4a3d-a48e-6677dd66417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:01.279957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-81c3642e-a1f2-4a3d-a48e-6677dd66417a None None] MFA Rules not processed for user `4633fe82f840475083533b1e67a6dbef`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:01.285919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-81c3642e-a1f2-4a3d-a48e-6677dd66417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:01.348349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1248/2525] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:24:01.359417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:01.361068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:01.416357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3574786-9d1e-4192-8ab7-22c11c03e602 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:01.420542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:01.421186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:01.421508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:01.421784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:01.423567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:01.484060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:01.485562 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:01.494377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1278/2526] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:03.715166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3642e-a1f2-4a3d-a48e-6677dd66417a None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:03.725134 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3642e-a1f2-4a3d-a48e-6677dd66417a None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:03.728819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:03.729493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:03.729776 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:03.730052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:03.731888 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:03.788511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:03.789915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:03.801153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1249/2527] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:05.423583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:05.432056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053d014-5849-4c8a-ad5a-ad565b9807d2 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:05.435741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b164f-a7e8-4739-97cf-b140bae0d26e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:05.436363 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b164f-a7e8-4739-97cf-b140bae0d26e service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:05.436644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b164f-a7e8-4739-97cf-b140bae0d26e service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:05.436918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b164f-a7e8-4739-97cf-b140bae0d26e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:05.445950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b164f-a7e8-4739-97cf-b140bae0d26e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:05.447393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b164f-a7e8-4739-97cf-b140bae0d26e service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:05.456725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1279/2528] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:10.297425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:10.361439 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076eb8a-d170-4c2f-a2bd-08f9370ae321 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:10.366155 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:10.367013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:10.367290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:10.367558 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] PATH_INFO: `/v3/users/cdc46f0e332b428c87142e01e8729ae2` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:10.368755 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc46f0e332b428c87142e01e8729ae2)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:10.370723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:10.595818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc46f0e332b428c87142e01e8729ae2'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:10.596494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc46f0e332b428c87142e01e8729ae2'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:10.756424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc46f0e332b428c87142e01e8729ae2'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:10.773986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc46f0e332b428c87142e01e8729ae2'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:10.774710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc46f0e332b428c87142e01e8729ae2'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:10.790402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1250/2529] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:24:10 2022] DELETE /identity/v3/users/cdc46f0e332b428c87142e01e8729ae2 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:10.795134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:10.795644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:10.795748 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:10.815809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:10.817055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:10.874614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1280/2530] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:10.884570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:10.886713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:10.925416 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:10.930635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:10.953707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78889cdc-4363-40e8-a24f-bb030f59d6a8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:10.958997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:10.959762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:10.960166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:10.960623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:10.970629 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:10.972197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:10.983250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1251/2531] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:24:11.002351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb392db-a5c1-4d7d-8fec-f3e7808a7c80 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:11.006420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:11.007234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:11.007520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:11.007799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:11.009805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:11.020611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:11.022093 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:11.030345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1281/2532] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:11.451676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:11.452458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:11.469163 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009e956-1714-4cae-8f99-48ea38187969 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:11.475994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:11.477697 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:11.478253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:11.478661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] PATH_INFO: `/v3/projects/15d8804876fd43e58a5a49462e5c615f` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:11.480159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d8804876fd43e58a5a49462e5c615f)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:11.482140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:11.623974 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d8804876fd43e58a5a49462e5c615f', 'request_id': 'req-dcb56301-b6a5-4495-b9ac-0a80632cc040'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:11.759996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d8804876fd43e58a5a49462e5c615f', 'request_id': 'req-dcb56301-b6a5-4495-b9ac-0a80632cc040'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:11.768124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d8804876fd43e58a5a49462e5c615f', 'request_id': 'req-dcb56301-b6a5-4495-b9ac-0a80632cc040'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:11.779197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] The token cache is being invalidate because project 15d8804876fd43e58a5a49462e5c615f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:24:11.781874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:11.781874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:11.782431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1252/2533] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:24:11 2022] DELETE /identity/v3/projects/15d8804876fd43e58a5a49462e5c615f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:11.786409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:11.798209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b09e9e-5344-4192-ae91-f3bd41aa2d10 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:11.857053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:11.858508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:11.859020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:11.859261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] PATH_INFO: `/v3/users/f9a2fdff013346d5bfd9e33f4d95f223` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:11.860627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a2fdff013346d5bfd9e33f4d95f223)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:11.862681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:12.175514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a2fdff013346d5bfd9e33f4d95f223'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:12.176244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a2fdff013346d5bfd9e33f4d95f223'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:12.192062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a2fdff013346d5bfd9e33f4d95f223'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:12.274681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a2fdff013346d5bfd9e33f4d95f223'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:12.275249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a2fdff013346d5bfd9e33f4d95f223'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:12.299629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1282/2534] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:24:11 2022] DELETE /identity/v3/users/f9a2fdff013346d5bfd9e33f4d95f223 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:13.540530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:13.542042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:13.555094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb56301-b6a5-4495-b9ac-0a80632cc040 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:13.623953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:13.625458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:13.625738 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:13.626008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] PATH_INFO: `/v3/projects/f8acd4448cc9463aada96d91a6110e75` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:13.627433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8acd4448cc9463aada96d91a6110e75)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:13.629403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:13.793651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8acd4448cc9463aada96d91a6110e75', 'request_id': 'req-c5f3a61b-ee14-453d-a299-099783ef04f4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:13.882221 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8acd4448cc9463aada96d91a6110e75', 'request_id': 'req-c5f3a61b-ee14-453d-a299-099783ef04f4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:13.889597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8acd4448cc9463aada96d91a6110e75', 'request_id': 'req-c5f3a61b-ee14-453d-a299-099783ef04f4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:13.900478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] The token cache is being invalidate because project f8acd4448cc9463aada96d91a6110e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:24:13.906577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:13.906577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:13.906577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1253/2535] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:24:13 2022] DELETE /identity/v3/projects/f8acd4448cc9463aada96d91a6110e75 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:13.907145 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:13.908591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:13.923795 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5bc05-0087-4a1a-aceb-83741be4e4d1 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:13.986601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:13.986601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:13.986601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:13.986601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] PATH_INFO: `/v3/users/4633fe82f840475083533b1e67a6dbef` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:13.987056 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4633fe82f840475083533b1e67a6dbef)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:13.987277 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:14.038858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:14.040285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:14.096405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3a61b-ee14-453d-a299-099783ef04f4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:14.100258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:14.100898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:14.101175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:14.101476 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:14.103266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:14.165437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:14.166949 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:14.176488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1254/2536] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:24:14.298692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4633fe82f840475083533b1e67a6dbef'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:14.299360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4633fe82f840475083533b1e67a6dbef'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:14.319558 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4633fe82f840475083533b1e67a6dbef'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:14.408267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4633fe82f840475083533b1e67a6dbef'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:14.409196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-1f1f1506-fa12-455f-a32b-a88db4d8b373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4633fe82f840475083533b1e67a6dbef'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:14.427857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1283/2537] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:24:13 2022] DELETE /identity/v3/users/4633fe82f840475083533b1e67a6dbef => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:15.022097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:15.026518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:15.048030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5ca5f-2020-4ea2-9231-6d263c3832a9 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:15.116307 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:15.117168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.117485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.117797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] PATH_INFO: `/v3/projects/76abb2dedaa0472aa9ae5f5d6d2aad4b` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.118994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=76abb2dedaa0472aa9ae5f5d6d2aad4b)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:15.120914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:15.226106 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76abb2dedaa0472aa9ae5f5d6d2aad4b', 'request_id': 'req-4727f3b9-caec-4427-8805-3b18d6903a0f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:15.300382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76abb2dedaa0472aa9ae5f5d6d2aad4b', 'request_id': 'req-4727f3b9-caec-4427-8805-3b18d6903a0f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:15.310087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76abb2dedaa0472aa9ae5f5d6d2aad4b', 'request_id': 'req-4727f3b9-caec-4427-8805-3b18d6903a0f'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:15.321601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] The token cache is being invalidate because project 76abb2dedaa0472aa9ae5f5d6d2aad4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:24:15.321924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:15.322552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-4727f3b9-caec-4427-8805-3b18d6903a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:15.324272 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1255/2538] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:24:15 2022] DELETE /identity/v3/projects/76abb2dedaa0472aa9ae5f5d6d2aad4b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:15.329851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8558a-604a-49c3-bb3d-b161bf6dff79 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.330887 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8558a-604a-49c3-bb3d-b161bf6dff79 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.331206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8558a-604a-49c3-bb3d-b161bf6dff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.351797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e3b8558a-604a-49c3-bb3d-b161bf6dff79 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:15.352778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e3b8558a-604a-49c3-bb3d-b161bf6dff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:15.437316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1284/2539] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:15.446230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55c5c3-db64-4075-ac84-eec14cbd2ee6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.446521 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55c5c3-db64-4075-ac84-eec14cbd2ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.446918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55c5c3-db64-4075-ac84-eec14cbd2ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.467667 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-0f55c5c3-db64-4075-ac84-eec14cbd2ee6 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:15.468918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0f55c5c3-db64-4075-ac84-eec14cbd2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:15.478980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1256/2540] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:15.483439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8558a-604a-49c3-bb3d-b161bf6dff79 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:15.494722 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8558a-604a-49c3-bb3d-b161bf6dff79 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:15.504112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:15.504874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.505443 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.505904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.506681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:24:15.506969 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:15.508609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:15.529379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1285/2541] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:24:15.531540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55c5c3-db64-4075-ac84-eec14cbd2ee6 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:15.542455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55c5c3-db64-4075-ac84-eec14cbd2ee6 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:15.547740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:15.548452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.548808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.549159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.550277 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:15.552832 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:15.650331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1257/2542] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:24:15 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:24:15.654451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:15.664853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8869f3-7d3d-4fd5-8461-74ab799a0094 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:15.731394 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:15.732126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.732425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.732943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.733703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:15.736407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:15.829263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1286/2543] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:24:15 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:24:15.831116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:15.844385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87979-7f9f-474b-8064-7b5e8f363364 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:15.858373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:15.859058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.859365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.859640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.860393 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:15.868966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:15.881821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1258/2544] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:24:15.884327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:15.898327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd134c22-d67d-4bf7-aa4c-a5652276f2df admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:15.903586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337af97-25e7-4546-8290-50103d26f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:15.904281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337af97-25e7-4546-8290-50103d26f4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.904606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337af97-25e7-4546-8290-50103d26f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.904853 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337af97-25e7-4546-8290-50103d26f4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.905647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337af97-25e7-4546-8290-50103d26f4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:15.907366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337af97-25e7-4546-8290-50103d26f4e9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:15.929708 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1287/2545] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:24:15.935727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:15.956939 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4944d-097d-4d25-8a92-b2e80c881fde admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:15.962163 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:15.963056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:15.963326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:15.963597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] PATH_INFO: `/v3/projects/39ab8e144b0f47c89a645f14e18fe9f1/users/c864bd9e8acc4d65ac2e58e0fb1ea6fe/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:15.979068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ab8e144b0f47c89a645f14e18fe9f1, user_id=c864bd9e8acc4d65ac2e58e0fb1ea6fe, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:15.981733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:16.079609 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1259/2546] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:24:15 2022] PUT /identity/v3/projects/39ab8e144b0f47c89a645f14e18fe9f1/users/c864bd9e8acc4d65ac2e58e0fb1ea6fe/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:16.084704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:16.084998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:16.085290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:16.104286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:16.105445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:16.163976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1288/2547] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:24:16.173961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:16.175741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:16.236438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a391e-1da1-4c86-990d-229294f585f7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:16.241844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e90e5-047a-4153-b618-cd6aac8c1d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:16.242495 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e90e5-047a-4153-b618-cd6aac8c1d2a service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:16.242783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e90e5-047a-4153-b618-cd6aac8c1d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:16.243192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e90e5-047a-4153-b618-cd6aac8c1d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:16.253154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e90e5-047a-4153-b618-cd6aac8c1d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:16.254630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e90e5-047a-4153-b618-cd6aac8c1d2a service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:16.265959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1260/2548] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:16.869777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:16.871479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:16.961820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0c6b8-b256-4827-9787-bed8bf520fb4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:16.969469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:16.970138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:16.970424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:16.970705 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:16.972634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:16.986037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:16.992314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:17.004826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1289/2549] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:18.127488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:18.128082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:18.128171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:18.158402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] MFA Rules not processed for user `c864bd9e8acc4d65ac2e58e0fb1ea6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:18.159740 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:18.228715 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:18.229230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1261/2550] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:18.230239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:18.239833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:18.241230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:18.246701 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a8131-39fe-4d23-a6d7-fb7f6cb9dcae service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:18.252015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:18.256390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:18.256390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:18.256390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] PATH_INFO: `/v3/users/5b5c229e1d0c4da7bc08c068d087a6bc` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:18.256390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5c229e1d0c4da7bc08c068d087a6bc)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:18.256796 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:18.299994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbbfd7-be03-46cf-8cb5-add98c56e09d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:18.303711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:18.304356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:18.304639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:18.304916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:18.314094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:18.316094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:18.325633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1262/2551] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:24:18.489821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5c229e1d0c4da7bc08c068d087a6bc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:18.490390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5c229e1d0c4da7bc08c068d087a6bc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:18.502767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5c229e1d0c4da7bc08c068d087a6bc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:18.619281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5c229e1d0c4da7bc08c068d087a6bc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:18.619872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fe999948-8bd1-40a4-94f7-f9dce888fa1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5c229e1d0c4da7bc08c068d087a6bc'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:18.632786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1290/2552] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:24:18 2022] DELETE /identity/v3/users/5b5c229e1d0c4da7bc08c068d087a6bc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:18.964365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:18.984339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3ceb-9bf1-4e78-8ca8-2cbfaa713e75 service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:19.047713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:19.048945 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:19.049509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:19.049988 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] PATH_INFO: `/v3/projects/2c9d14816d4e4f7c9fdd17604fe92747` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:19.051437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9d14816d4e4f7c9fdd17604fe92747)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:19.053622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:19.223847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9d14816d4e4f7c9fdd17604fe92747', 'request_id': 'req-9cb1d235-2131-4769-9bd4-92d13462da5a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:19.344625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9d14816d4e4f7c9fdd17604fe92747', 'request_id': 'req-9cb1d235-2131-4769-9bd4-92d13462da5a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:19.351610 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9d14816d4e4f7c9fdd17604fe92747', 'request_id': 'req-9cb1d235-2131-4769-9bd4-92d13462da5a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:19.362360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] The token cache is being invalidate because project 2c9d14816d4e4f7c9fdd17604fe92747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:24:19.362754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:19.363329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:19.364925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1263/2553] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:24:18 2022] DELETE /identity/v3/projects/2c9d14816d4e4f7c9fdd17604fe92747 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:20.176141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:20.176678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:20.176975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:20.195614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] MFA Rules not processed for user `c864bd9e8acc4d65ac2e58e0fb1ea6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:20.196836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:20.252403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1291/2554] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:20.486339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:20.487768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:20.545073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1d235-2131-4769-9bd4-92d13462da5a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:20.549391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1a5b6-57f3-478b-9e68-29787c58a85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:20.549971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1a5b6-57f3-478b-9e68-29787c58a85e service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:20.550253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1a5b6-57f3-478b-9e68-29787c58a85e service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:20.550528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1a5b6-57f3-478b-9e68-29787c58a85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:20.552348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a8c1a5b6-57f3-478b-9e68-29787c58a85e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:20.561618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1a5b6-57f3-478b-9e68-29787c58a85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:20.563695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1a5b6-57f3-478b-9e68-29787c58a85e service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:20.571501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1264/2555] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:24:21.015851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:21.017656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:21.094876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94c06f-90fc-4ebb-927f-24b914f50982 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:21.101222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:21.102348 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:21.102641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:21.102924 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:21.104771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:21.121560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:21.123428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:21.137354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1292/2556] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:22.557170 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:22.557682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:22.557793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:22.564647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:22.566166 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:22.578422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:22.579630 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:22.622227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb720db-9a26-470c-bb0a-d6abcf5e4159 service placement] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:22.625908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:22.628338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:22.628338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:22.628338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:22.628947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:22.635971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1265/2557] 10.222.0.31 () {58 vars in 967 bytes} [Sat Feb 12 04:24:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:22.691690 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:22.693125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:22.702074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1293/2558] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:24:22.826554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:22.828475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:22.901169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb191483-783b-45d1-bcd5-49112a3b4706 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:22.906415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:22.908591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:22.908591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:22.908591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:22.915792 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:22.917388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:22.926827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1266/2559] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:24:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:24:27.303775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:27.305430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:27.402659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd1f2e-c22f-44c9-b8a9-9b2668b256e4 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:27.411055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:27.412090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:27.412606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:27.413249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:27.416087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:27.432774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:27.436596 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:27.449754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1294/2560] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:31.198457 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:31.199844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:31.215425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dc7d6-256f-49b7-b2b0-3f6b26e63164 service swift] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:31.221834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18219a6e-d5b5-4ce7-aaad-137e1e834ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:31.222326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18219a6e-d5b5-4ce7-aaad-137e1e834ed1 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:31.222607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18219a6e-d5b5-4ce7-aaad-137e1e834ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:31.222882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18219a6e-d5b5-4ce7-aaad-137e1e834ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:31.224758 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-18219a6e-d5b5-4ce7-aaad-137e1e834ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:31.292253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18219a6e-d5b5-4ce7-aaad-137e1e834ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:31.293997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18219a6e-d5b5-4ce7-aaad-137e1e834ed1 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:31.303402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1267/2561] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:24:32.491861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:32.505943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e0986-08b2-44ce-b64d-51668e5b9c17 service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:32.512448 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:32.513195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:32.513506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:32.517591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:32.517591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:32.528517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:32.530122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:32.541310 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1295/2562] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:34.176878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358ac9-bde3-421c-972c-65dd56f43291 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:34.177376 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358ac9-bde3-421c-972c-65dd56f43291 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:34.177477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358ac9-bde3-421c-972c-65dd56f43291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:34.201261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-bc358ac9-bde3-421c-972c-65dd56f43291 None None] MFA Rules not processed for user `19c700111c474ff596979fb4150fa15c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:34.202538 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bc358ac9-bde3-421c-972c-65dd56f43291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:34.210371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1268/2563] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:34.506471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:34.508769 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:34.579714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76004-df21-4204-bcb4-7a8e8242d230 service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:34.585506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:34.586404 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:34.586712 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:34.586991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] PATH_INFO: `/v3/users/5c6aef15658546e7a2f0592119184000` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:34.588257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6aef15658546e7a2f0592119184000)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:34.590244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:34.802640 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6aef15658546e7a2f0592119184000'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:34.803305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6aef15658546e7a2f0592119184000'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:34.816076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6aef15658546e7a2f0592119184000'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:34.918971 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6aef15658546e7a2f0592119184000'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:34.930913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6aef15658546e7a2f0592119184000'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:34.956368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1296/2564] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:24:34 2022] DELETE /identity/v3/users/5c6aef15658546e7a2f0592119184000 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:35.319024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358ac9-bde3-421c-972c-65dd56f43291 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:35.334168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358ac9-bde3-421c-972c-65dd56f43291 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:35.391856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:35.392790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:35.393160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:35.393639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] PATH_INFO: `/v3/projects/5e5dbd3a980c4a1cb1d42b3a8b962124` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:35.395084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5dbd3a980c4a1cb1d42b3a8b962124)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:35.401038 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:35.511119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'request_id': 'req-bda382f1-562c-40a6-b487-4c9c0c96a74b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:35.596070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'request_id': 'req-bda382f1-562c-40a6-b487-4c9c0c96a74b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:35.603154 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5dbd3a980c4a1cb1d42b3a8b962124', 'request_id': 'req-bda382f1-562c-40a6-b487-4c9c0c96a74b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:35.614390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] The token cache is being invalidate because project 5e5dbd3a980c4a1cb1d42b3a8b962124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:24:35.614682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:35.615382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:35.619924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1269/2565] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:24:35 2022] DELETE /identity/v3/projects/5e5dbd3a980c4a1cb1d42b3a8b962124 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:35.620981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:35.622497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:35.636092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abea71-74f8-483c-a2b7-01e5e33a0905 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:35.688733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:35.689619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:35.689904 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:35.690178 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] PATH_INFO: `/v3/users/0a9c3da2c6b34ff1bec7cc8afd4f7205` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:35.691403 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9c3da2c6b34ff1bec7cc8afd4f7205)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:35.693364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:35.915697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9c3da2c6b34ff1bec7cc8afd4f7205'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:35.916355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9c3da2c6b34ff1bec7cc8afd4f7205'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:35.928726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9c3da2c6b34ff1bec7cc8afd4f7205'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.016186 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9c3da2c6b34ff1bec7cc8afd4f7205'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.017125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-89569cef-cb29-4067-973f-efe0a74a424d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9c3da2c6b34ff1bec7cc8afd4f7205'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.029890 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1297/2566] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:24:35 2022] DELETE /identity/v3/users/0a9c3da2c6b34ff1bec7cc8afd4f7205 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:24:36.411271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:36.415311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:36.436228 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda382f1-562c-40a6-b487-4c9c0c96a74b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:36.492735 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:36.493620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:36.493904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:36.494238 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] PATH_INFO: `/v3/projects/9e769c3a1f0c4a99aa9d6542b1fd091c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:36.495429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e769c3a1f0c4a99aa9d6542b1fd091c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:36.497395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:36.584321 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e769c3a1f0c4a99aa9d6542b1fd091c', 'request_id': 'req-fe090873-0680-4f10-a836-320d1e8fe152'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.679115 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e769c3a1f0c4a99aa9d6542b1fd091c', 'request_id': 'req-fe090873-0680-4f10-a836-320d1e8fe152'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.688024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e769c3a1f0c4a99aa9d6542b1fd091c', 'request_id': 'req-fe090873-0680-4f10-a836-320d1e8fe152'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.697416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] The token cache is being invalidate because project 9e769c3a1f0c4a99aa9d6542b1fd091c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:24:36.697705 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.698360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:24:36.699882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1270/2567] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:24:36 2022] DELETE /identity/v3/projects/9e769c3a1f0c4a99aa9d6542b1fd091c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:24:39.882305 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ed1c-d6fa-4edd-a814-ebc8a0b62c83 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:39.882949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ed1c-d6fa-4edd-a814-ebc8a0b62c83 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:39.882949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ed1c-d6fa-4edd-a814-ebc8a0b62c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:39.902401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5a94ed1c-d6fa-4edd-a814-ebc8a0b62c83 None None] MFA Rules not processed for user `c864bd9e8acc4d65ac2e58e0fb1ea6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:39.903669 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5a94ed1c-d6fa-4edd-a814-ebc8a0b62c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:39.967154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1298/2568] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:24:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:40.204898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:40.206329 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:40.263317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe090873-0680-4f10-a836-320d1e8fe152 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:40.266821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:40.268301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:40.268924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:40.269205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:40.271042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:40.281434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:40.282895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:40.291079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1271/2569] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:24:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:24:50.407932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd912-8270-4b88-bbea-472e8aa9b3f3 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:50.408505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd912-8270-4b88-bbea-472e8aa9b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:50.408505 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd912-8270-4b88-bbea-472e8aa9b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:50.435191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-944cd912-8270-4b88-bbea-472e8aa9b3f3 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:24:50.436376 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-944cd912-8270-4b88-bbea-472e8aa9b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:50.495073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1299/2570] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:24:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:24:50.507926 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:24:50.509239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:24:50.577239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e224aed-be75-42ee-990e-d12e21b24348 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:24:50.583362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:24:50.584018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:24:50.584301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:24:50.584576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:24:50.593481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:24:50.595107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:24:50.603641 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1272/2571] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:24:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:02.085898 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e998-6827-41a9-978f-aac819136fbf None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:02.086392 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e998-6827-41a9-978f-aac819136fbf None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:02.086487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e998-6827-41a9-978f-aac819136fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:02.103652 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-f563e998-6827-41a9-978f-aac819136fbf None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:02.104830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f563e998-6827-41a9-978f-aac819136fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:02.112131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1300/2572] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:02.124634 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:02.135013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a67b9-c079-464e-a622-9278fc20c724 service swift] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:02.140572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218841a-02b4-4ea4-95d6-d0ec82da31e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:02.141195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218841a-02b4-4ea4-95d6-d0ec82da31e8 service swift] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:02.141687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218841a-02b4-4ea4-95d6-d0ec82da31e8 service swift] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:02.141966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218841a-02b4-4ea4-95d6-d0ec82da31e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:02.150097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218841a-02b4-4ea4-95d6-d0ec82da31e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:02.151659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218841a-02b4-4ea4-95d6-d0ec82da31e8 service swift] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:02.159656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1273/2573] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:08.107067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b7b4-9b5a-4d0b-a7a9-b9c387921635 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.107629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b7b4-9b5a-4d0b-a7a9-b9c387921635 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.107629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b7b4-9b5a-4d0b-a7a9-b9c387921635 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.109738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1301/2574] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:08.115620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af2238-65c9-48ad-a5e0-38be136ae4c6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.116114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af2238-65c9-48ad-a5e0-38be136ae4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.116214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af2238-65c9-48ad-a5e0-38be136ae4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.136374 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c0af2238-65c9-48ad-a5e0-38be136ae4c6 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:08.137632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c0af2238-65c9-48ad-a5e0-38be136ae4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:08.238713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1274/2575] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:25:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:08.248424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b7b4-9b5a-4d0b-a7a9-b9c387921635 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:08.250768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-aeb8b7b4-9b5a-4d0b-a7a9-b9c387921635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:08.362293 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b7b4-9b5a-4d0b-a7a9-b9c387921635 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:08.368490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfa849-ab8c-44be-a2bd-643ca726444d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:08.369533 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfa849-ab8c-44be-a2bd-643ca726444d service glance] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.370071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfa849-ab8c-44be-a2bd-643ca726444d service glance] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.370556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfa849-ab8c-44be-a2bd-643ca726444d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.384743 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfa849-ab8c-44be-a2bd-643ca726444d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:08.386458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfa849-ab8c-44be-a2bd-643ca726444d service glance] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:08.404064 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1302/2576] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:08.707395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3a23-ae1e-4f7f-8140-00f68bb5df47 None None] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.707995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3a23-ae1e-4f7f-8140-00f68bb5df47 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.708620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3a23-ae1e-4f7f-8140-00f68bb5df47 None None] PATH_INFO: `/` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.712144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1275/2577] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:25:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:08.718508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605f4b-97ff-4d04-a029-1e7b721be6d6 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.719260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605f4b-97ff-4d04-a029-1e7b721be6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.719674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50605f4b-97ff-4d04-a029-1e7b721be6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.740874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-50605f4b-97ff-4d04-a029-1e7b721be6d6 None None] MFA Rules not processed for user `5157463790394bcbae9c0d7e5812f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:08.742134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-50605f4b-97ff-4d04-a029-1e7b721be6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:08.750709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1303/2578] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:25:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:25:08.763860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3a23-ae1e-4f7f-8140-00f68bb5df47 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:08.777853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3a23-ae1e-4f7f-8140-00f68bb5df47 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:08.782877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33667f2d-d3f2-4365-b5e6-dcf93a29996b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:08.783730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667f2d-d3f2-4365-b5e6-dcf93a29996b service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.784071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667f2d-d3f2-4365-b5e6-dcf93a29996b service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.784451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667f2d-d3f2-4365-b5e6-dcf93a29996b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.794480 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33667f2d-d3f2-4365-b5e6-dcf93a29996b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:08.797016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33667f2d-d3f2-4365-b5e6-dcf93a29996b service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:08.816665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1276/2579] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:25:08.919199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc398e-612b-4030-8bc5-2a3cab138ec9 None None] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.919497 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc398e-612b-4030-8bc5-2a3cab138ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.919768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc398e-612b-4030-8bc5-2a3cab138ec9 None None] PATH_INFO: `/` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.922326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1304/2580] 10.222.0.31 () {54 vars in 921 bytes} [Sat Feb 12 04:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:08.930500 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18a74-2250-4d97-809f-97e2322fa9a6 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:08.931047 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18a74-2250-4d97-809f-97e2322fa9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:08.931468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18a74-2250-4d97-809f-97e2322fa9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:08.954428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-fec18a74-2250-4d97-809f-97e2322fa9a6 None None] MFA Rules not processed for user `4509a13ccb074c5e9d8440755da77cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:08.955743 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-fec18a74-2250-4d97-809f-97e2322fa9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:08.973883 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1277/2581] 10.222.0.31 () {58 vars in 1018 bytes} [Sat Feb 12 04:25:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:08.982258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc398e-612b-4030-8bc5-2a3cab138ec9 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:08.987729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f2bc398e-612b-4030-8bc5-2a3cab138ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:09.006577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc398e-612b-4030-8bc5-2a3cab138ec9 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:09.012112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:09.013035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:09.013390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:09.015657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:09.031101 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:09.032785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:09.049966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1305/2582] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:11.957069 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb05b-2870-4834-8180-0560d833e1c3 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:11.958366 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb05b-2870-4834-8180-0560d833e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:11.958853 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb05b-2870-4834-8180-0560d833e1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:11.984985 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-5f4cb05b-2870-4834-8180-0560d833e1c3 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:11.986414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5f4cb05b-2870-4834-8180-0560d833e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:11.994438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1278/2583] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:25:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:12.010695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:12.023782 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a2d2-da7b-4055-884c-fd697acf677c service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:12.029355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:12.030021 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:12.030312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:12.030745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:12.041574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:12.043146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:12.051540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1306/2584] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:20.644273 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:20.644866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:20.644866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:20.667350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:20.669020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:20.687516 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1279/2585] 10.222.0.31 () {58 vars in 967 bytes} [Sat Feb 12 04:25:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:20.705913 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:20.717172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a456490-5047-4e2a-b6c5-ec8563f97627 service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:20.723572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:20.724218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:20.724714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:20.725022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:20.734122 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:20.735696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:20.744296 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1307/2586] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:25:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:24.058132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:24.058132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:24.122835 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1201-418b-43eb-817e-8c736d8db7bc None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:24.127441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:24.129660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:24.129660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:24.129660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] PATH_INFO: `/v3/users/c864bd9e8acc4d65ac2e58e0fb1ea6fe` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:24.130112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c864bd9e8acc4d65ac2e58e0fb1ea6fe)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:24.131976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:24.340960 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:24.341640 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:24.430102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:24.442350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:24.443024 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-6e75e508-8ec2-4de2-986b-1252282b68d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c864bd9e8acc4d65ac2e58e0fb1ea6fe'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:24.455276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1280/2587] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:25:24 2022] DELETE /identity/v3/users/c864bd9e8acc4d65ac2e58e0fb1ea6fe => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:24.705346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:24.718600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c419b-95c2-4447-b432-8bbc583ab04f service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:24.775614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:24.776461 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:24.776746 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:24.777020 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] PATH_INFO: `/v3/projects/39ab8e144b0f47c89a645f14e18fe9f1` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:24.778372 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ab8e144b0f47c89a645f14e18fe9f1)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:24.781010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:24.924723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ab8e144b0f47c89a645f14e18fe9f1', 'request_id': 'req-c704d7be-da92-4967-90b3-e93a8d027f25'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:25.044246 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ab8e144b0f47c89a645f14e18fe9f1', 'request_id': 'req-c704d7be-da92-4967-90b3-e93a8d027f25'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:25.052061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ab8e144b0f47c89a645f14e18fe9f1', 'request_id': 'req-c704d7be-da92-4967-90b3-e93a8d027f25'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:25.065354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] The token cache is being invalidate because project 39ab8e144b0f47c89a645f14e18fe9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:25:25.065654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:25.066341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:25.068033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1308/2588] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:25:24 2022] DELETE /identity/v3/projects/39ab8e144b0f47c89a645f14e18fe9f1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:26.308711 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:26.309197 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:26.309512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:26.327907 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:26.329160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:26.401243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1281/2589] 10.222.0.31 () {58 vars in 967 bytes} [Sat Feb 12 04:25:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:26.426488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:26.430114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:26.494378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704d7be-da92-4967-90b3-e93a8d027f25 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:26.499152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:26.499778 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:26.500057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:26.500330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:26.508049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:26.509647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:26.517954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1309/2590] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:25:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:25:47.736243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:47.737749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:47.921310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c73626-eaa7-4d42-ba83-d5cf71233b16 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:47.924734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:47.925381 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:47.925661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:47.925930 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:47.928391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:47.986771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:47.988188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:47.997569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1282/2591] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:51.763714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:51.765123 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:51.779726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00ab14-0d6b-4268-a88c-3f48c87e30ae service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:51.784257 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:51.785138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:51.785457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:51.785737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] PATH_INFO: `/v3/users/19c700111c474ff596979fb4150fa15c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:51.786943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c700111c474ff596979fb4150fa15c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:51.788850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:51.987130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c700111c474ff596979fb4150fa15c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:51.987787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c700111c474ff596979fb4150fa15c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:51.999590 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c700111c474ff596979fb4150fa15c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.077466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c700111c474ff596979fb4150fa15c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.078128 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c17da511-5faf-4469-9e57-023edbe975af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c700111c474ff596979fb4150fa15c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.090642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1310/2592] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:25:51 2022] DELETE /identity/v3/users/19c700111c474ff596979fb4150fa15c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:52.324580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:52.335955 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d74a3-0da8-4340-9417-ea9df52b8800 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:52.391333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:52.392169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.392445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.392718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] PATH_INFO: `/v3/projects/e56e0fac86874323b726d0897d3cd6e5` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.393994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56e0fac86874323b726d0897d3cd6e5)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:52.395901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:52.495396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56e0fac86874323b726d0897d3cd6e5', 'request_id': 'req-1567c316-f97b-4b49-bd87-bd1dcb8c4953'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.580220 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56e0fac86874323b726d0897d3cd6e5', 'request_id': 'req-1567c316-f97b-4b49-bd87-bd1dcb8c4953'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.594925 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56e0fac86874323b726d0897d3cd6e5', 'request_id': 'req-1567c316-f97b-4b49-bd87-bd1dcb8c4953'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.596981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] The token cache is being invalidate because project e56e0fac86874323b726d0897d3cd6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:25:52.597268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.598526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1567c316-f97b-4b49-bd87-bd1dcb8c4953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:52.600029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1283/2593] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:25:52 2022] DELETE /identity/v3/projects/e56e0fac86874323b726d0897d3cd6e5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:52.604906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935d8d-3b13-481f-ad84-ab862ac61c6f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.605190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935d8d-3b13-481f-ad84-ab862ac61c6f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.605498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70935d8d-3b13-481f-ad84-ab862ac61c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.623897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-70935d8d-3b13-481f-ad84-ab862ac61c6f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:52.625075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-70935d8d-3b13-481f-ad84-ab862ac61c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:52.682338 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1311/2594] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:52.689954 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396cdf9-bf28-4ec3-a3fd-d7a3119e8a54 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.690301 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396cdf9-bf28-4ec3-a3fd-d7a3119e8a54 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.690696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396cdf9-bf28-4ec3-a3fd-d7a3119e8a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.708852 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9396cdf9-bf28-4ec3-a3fd-d7a3119e8a54 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:52.710080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9396cdf9-bf28-4ec3-a3fd-d7a3119e8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:52.718260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1284/2595] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:52.722462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935d8d-3b13-481f-ad84-ab862ac61c6f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:52.732517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70935d8d-3b13-481f-ad84-ab862ac61c6f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:52.738587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:52.738587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.738587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.738587 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.739187 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:25:52.739488 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:52.741049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:52.752157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1312/2596] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:25:52.756378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396cdf9-bf28-4ec3-a3fd-d7a3119e8a54 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:52.769177 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396cdf9-bf28-4ec3-a3fd-d7a3119e8a54 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:52.774378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:52.775055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.775361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.775631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.776323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:52.778229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:52.867007 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1285/2597] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:25:52 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:25:52.871120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:52.881012 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337418b7-1aa6-4add-818e-452a62a3ed43 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:52.934464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:52.934979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.935264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.935535 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.936230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:52.938222 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.015379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1313/2598] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:25:52 2022] POST /identity/v3/users => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:25:53.019442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.030183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68458b-118d-4c27-9784-2256da7d34fd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.034815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.035454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.035734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.036006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.036762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.038369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.048164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1286/2599] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:25:53.052039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.061835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72de0f-04d9-4b73-9fce-fb5bb87beea4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.066374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fe626-dcd4-4ecc-9090-4732244aca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.067543 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe626-dcd4-4ecc-9090-4732244aca1a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.067819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe626-dcd4-4ecc-9090-4732244aca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.068089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe626-dcd4-4ecc-9090-4732244aca1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.068810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fe626-dcd4-4ecc-9090-4732244aca1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.070437 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fe626-dcd4-4ecc-9090-4732244aca1a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.079958 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1314/2600] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:25:53.084478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.094214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7e9f4-7066-4083-a08a-03d3f76f423b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.098782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.099631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.099912 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.100188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] PATH_INFO: `/v3/projects/dfcd3465faf74c0bae043744bd5050ac/users/6009bb8975944cb096f218f228932f60/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.114171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcd3465faf74c0bae043744bd5050ac, user_id=6009bb8975944cb096f218f228932f60, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.120580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.168511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1287/2601] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:25:53 2022] PUT /identity/v3/projects/dfcd3465faf74c0bae043744bd5050ac/users/6009bb8975944cb096f218f228932f60/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:25:53.178452 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fbf61-0f61-4111-b105-d3372b0919a9 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.178768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fbf61-0f61-4111-b105-d3372b0919a9 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.179125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fbf61-0f61-4111-b105-d3372b0919a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.205211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-703fbf61-0f61-4111-b105-d3372b0919a9 None None] MFA Rules not processed for user `6009bb8975944cb096f218f228932f60`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:53.206446 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-703fbf61-0f61-4111-b105-d3372b0919a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:53.266824 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1315/2602] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:53.272002 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.330283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542ee01-d55a-4141-86c8-33a3e6474b72 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.334917 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.335555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.335837 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.336114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.336815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.338725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.432982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1288/2603] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:25:53 2022] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:25:53.437109 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fbf61-0f61-4111-b105-d3372b0919a9 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.447725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fbf61-0f61-4111-b105-d3372b0919a9 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.500223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.500868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.501146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.501445 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.502148 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.504038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.568508 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1316/2604] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:25:53 2022] POST /identity/v3/users => generated 309 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:25:53.572392 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.582849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f99d-3930-462c-a255-34a54e9852ce admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.587580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.588217 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.588498 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.588773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.589535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.591100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.601678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1289/2605] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:25:53.605629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.615595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cd5cc-00e0-40ac-ba58-108cc0ee21f4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.620202 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.621057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.621374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.621654 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] PATH_INFO: `/v3/projects/a7537b6a6d4e4930a3e0d82284543633/users/c1789adeb77840cca349466e4d4306ef/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.635643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7537b6a6d4e4930a3e0d82284543633, user_id=c1789adeb77840cca349466e4d4306ef, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.638306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.734809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1317/2606] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:25:53 2022] PUT /identity/v3/projects/a7537b6a6d4e4930a3e0d82284543633/users/c1789adeb77840cca349466e4d4306ef/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:53.738812 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.748483 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d2a1-e0bf-4166-8bb8-78679bbf8ad8 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.811303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44398be0-2434-408b-844b-9b5ac30d7452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.811952 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44398be0-2434-408b-844b-9b5ac30d7452 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.812233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44398be0-2434-408b-844b-9b5ac30d7452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.812506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44398be0-2434-408b-844b-9b5ac30d7452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.813236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44398be0-2434-408b-844b-9b5ac30d7452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.814856 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44398be0-2434-408b-844b-9b5ac30d7452 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.824680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1290/2607] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:25:53.828906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.840060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82de005-2321-4244-9382-e10f2945f74b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:53.844632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:53.845532 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.845820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.846095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] PATH_INFO: `/v3/projects/a7537b6a6d4e4930a3e0d82284543633/users/c1789adeb77840cca349466e4d4306ef/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.848078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7537b6a6d4e4930a3e0d82284543633, user_id=c1789adeb77840cca349466e4d4306ef, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:53.850732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:53.860999 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1318/2608] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:25:53 2022] PUT /identity/v3/projects/a7537b6a6d4e4930a3e0d82284543633/users/c1789adeb77840cca349466e4d4306ef/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:53.872034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7719c1-4589-435a-b137-5328707b07a1 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:53.872320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7719c1-4589-435a-b137-5328707b07a1 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:53.872597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7719c1-4589-435a-b137-5328707b07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:53.898493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9b7719c1-4589-435a-b137-5328707b07a1 None None] MFA Rules not processed for user `c1789adeb77840cca349466e4d4306ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:53.899681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9b7719c1-4589-435a-b137-5328707b07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:53.963892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1291/2609] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:53.973375 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:53.975144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:54.029931 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb1b6-67ee-41ee-b839-ba4f3ff79c46 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:54.033454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e05793-261c-4736-ba97-16a65715ed85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:54.034085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e05793-261c-4736-ba97-16a65715ed85 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:54.034366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e05793-261c-4736-ba97-16a65715ed85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:54.034641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e05793-261c-4736-ba97-16a65715ed85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:54.043463 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e05793-261c-4736-ba97-16a65715ed85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:54.051595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e05793-261c-4736-ba97-16a65715ed85 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:54.054550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1319/2610] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:54.187625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7719c1-4589-435a-b137-5328707b07a1 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:54.246681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7719c1-4589-435a-b137-5328707b07a1 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:54.251276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:54.252122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:54.252404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:54.252679 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] PATH_INFO: `/v3/users/6009bb8975944cb096f218f228932f60` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:54.253881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6009bb8975944cb096f218f228932f60)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:54.256445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:54.445005 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6009bb8975944cb096f218f228932f60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:54.445713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6009bb8975944cb096f218f228932f60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:54.528924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6009bb8975944cb096f218f228932f60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:54.541571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6009bb8975944cb096f218f228932f60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:54.542181 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6009bb8975944cb096f218f228932f60'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:54.554531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1292/2611] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:25:54 2022] DELETE /identity/v3/users/6009bb8975944cb096f218f228932f60 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:54.559235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:54.559527 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:54.559806 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:54.577080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:54.578316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:54.634090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1320/2612] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:54.643454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:54.644892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:54.699773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881a434-6a95-4b88-96f9-d484577a308a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:54.703348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:54.703970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:54.704258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:54.704535 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:54.713229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:54.714674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:54.724256 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1293/2613] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:55.368427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:55.369857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:55.383284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1aaae-83a1-48ba-97bb-22218465829e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:55.388107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:55.388952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:55.389231 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:55.389545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] PATH_INFO: `/v3/projects/dfcd3465faf74c0bae043744bd5050ac` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:55.390907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcd3465faf74c0bae043744bd5050ac)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:55.392814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:55.486290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcd3465faf74c0bae043744bd5050ac', 'request_id': 'req-14851dc0-c734-423d-b52d-01b9aa95d0a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.557430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcd3465faf74c0bae043744bd5050ac', 'request_id': 'req-14851dc0-c734-423d-b52d-01b9aa95d0a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.562837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcd3465faf74c0bae043744bd5050ac', 'request_id': 'req-14851dc0-c734-423d-b52d-01b9aa95d0a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.574074 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] The token cache is being invalidate because project dfcd3465faf74c0bae043744bd5050ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:25:55.574364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.574984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.576521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1321/2614] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:25:55 2022] DELETE /identity/v3/projects/dfcd3465faf74c0bae043744bd5050ac => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:55.580520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:55.589924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46242b4-0cb6-4005-9b53-109aa1fda0d2 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:55.642229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:55.643082 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:55.643364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:55.643669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] PATH_INFO: `/v3/users/c1789adeb77840cca349466e4d4306ef` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:55.644895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1789adeb77840cca349466e4d4306ef)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:55.646878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:55.815119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1789adeb77840cca349466e4d4306ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.815771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1789adeb77840cca349466e4d4306ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.882744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1789adeb77840cca349466e4d4306ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.894243 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1789adeb77840cca349466e4d4306ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.894893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7fdaaca2-e31f-43a8-a8ce-4f5855bed66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1789adeb77840cca349466e4d4306ef'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:55.906550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1294/2615] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:25:55 2022] DELETE /identity/v3/users/c1789adeb77840cca349466e4d4306ef => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:56.301884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:56.303309 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:56.316506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14851dc0-c734-423d-b52d-01b9aa95d0a3 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:56.372886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:56.373766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.374045 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.374345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] PATH_INFO: `/v3/projects/a7537b6a6d4e4930a3e0d82284543633` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.375643 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7537b6a6d4e4930a3e0d82284543633)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:56.377554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:56.503319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7537b6a6d4e4930a3e0d82284543633', 'request_id': 'req-ca52ccd0-d8b9-4d4f-a028-3450d579e336'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:56.563142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7537b6a6d4e4930a3e0d82284543633', 'request_id': 'req-ca52ccd0-d8b9-4d4f-a028-3450d579e336'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:56.568617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7537b6a6d4e4930a3e0d82284543633', 'request_id': 'req-ca52ccd0-d8b9-4d4f-a028-3450d579e336'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:56.579156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] The token cache is being invalidate because project a7537b6a6d4e4930a3e0d82284543633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:25:56.579441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:56.580054 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-ca52ccd0-d8b9-4d4f-a028-3450d579e336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:56.581591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1322/2616] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:25:56 2022] DELETE /identity/v3/projects/a7537b6a6d4e4930a3e0d82284543633 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:56.587019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f69544-a31e-4ad9-b8ad-93ccfd12a850 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.587506 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f69544-a31e-4ad9-b8ad-93ccfd12a850 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.587603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f69544-a31e-4ad9-b8ad-93ccfd12a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.605669 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-37f69544-a31e-4ad9-b8ad-93ccfd12a850 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:56.606871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-37f69544-a31e-4ad9-b8ad-93ccfd12a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:56.661185 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1295/2617] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:25:56.671271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f603e6-25fb-4329-bfe9-a1ff5dcc1043 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.671561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f603e6-25fb-4329-bfe9-a1ff5dcc1043 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.671840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f603e6-25fb-4329-bfe9-a1ff5dcc1043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.690713 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e2f603e6-25fb-4329-bfe9-a1ff5dcc1043 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:56.691916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e2f603e6-25fb-4329-bfe9-a1ff5dcc1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:56.700336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1323/2618] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:56.704373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f69544-a31e-4ad9-b8ad-93ccfd12a850 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:56.714242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f69544-a31e-4ad9-b8ad-93ccfd12a850 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:56.718781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:56.719412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.719694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.719969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.720697 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:25:56.721006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:56.722689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:56.733799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1296/2619] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:25:56.739966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f603e6-25fb-4329-bfe9-a1ff5dcc1043 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:56.749039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f603e6-25fb-4329-bfe9-a1ff5dcc1043 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:56.753718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:56.754378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.754660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.754937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.756253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:56.758171 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:56.851241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1324/2620] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:25:56 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:25:56.855699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:56.866076 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64fbf-a22b-464e-b226-37f1577c96f0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:56.919326 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:56.920003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.920288 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.920582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.921266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:56.923173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.026503 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1297/2621] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:25:56 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:25:57.030730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.040827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7069451-e0ce-4c18-bb88-63822541afb8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.045520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.046164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.046453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.046726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.047520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.049106 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.059576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1325/2622] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:25:57.063309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.073534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172fb99-9b85-40b2-b95d-292ebf6658fe admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.078158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd7be3-4af6-4c91-a583-da745b8460f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.078788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7be3-4af6-4c91-a583-da745b8460f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.079072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7be3-4af6-4c91-a583-da745b8460f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.079351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd7be3-4af6-4c91-a583-da745b8460f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.080083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7be3-4af6-4c91-a583-da745b8460f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.081695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd7be3-4af6-4c91-a583-da745b8460f3 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.091102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1298/2623] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:25:57.094980 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.104544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148aa37-2f09-4cce-af1d-a5de405a2356 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.109164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.110318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.110605 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.110874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] PATH_INFO: `/v3/projects/779a8f846b4b47e2bb24543b7a6ab2c7/users/d86c52c0cd0b4525af944dcd98380013/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.125781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779a8f846b4b47e2bb24543b7a6ab2c7, user_id=d86c52c0cd0b4525af944dcd98380013, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.128516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.242727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1326/2624] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:25:57 2022] PUT /identity/v3/projects/779a8f846b4b47e2bb24543b7a6ab2c7/users/d86c52c0cd0b4525af944dcd98380013/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:25:57.252878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e63f-e950-4f48-85f8-9a5cdb13f1ad None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.254906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e63f-e950-4f48-85f8-9a5cdb13f1ad None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.254906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e63f-e950-4f48-85f8-9a5cdb13f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.279419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-0f70e63f-e950-4f48-85f8-9a5cdb13f1ad None None] MFA Rules not processed for user `d86c52c0cd0b4525af944dcd98380013`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:57.280638 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0f70e63f-e950-4f48-85f8-9a5cdb13f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:57.341524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1299/2625] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:57.346013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.404642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24b8d-d68e-499c-99c9-33c31856e537 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.409255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.409921 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.410204 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.410483 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.411175 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.414703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.536216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1327/2626] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:25:57 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:25:57.540803 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e63f-e950-4f48-85f8-9a5cdb13f1ad None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.552522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e63f-e950-4f48-85f8-9a5cdb13f1ad None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.604603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.605240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.605537 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.605807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.606493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.608414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.683666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1300/2627] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:25:57 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:25:57.687714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.697836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159506de-de5d-4b7a-865d-e55100298e7d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.702401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.703046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.703326 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.703600 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.704359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.705978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.715967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1328/2628] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:25:57.719943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.729996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16a68c-bf19-4255-bcb7-726fbc8d6f36 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.734916 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.735847 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.736183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.736460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] PATH_INFO: `/v3/projects/8e729d2c0d7c433aa1c9537a4fae30a3/users/e9d30685355c4a68b6d95797e308ac89/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.752232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e729d2c0d7c433aa1c9537a4fae30a3, user_id=e9d30685355c4a68b6d95797e308ac89, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.754921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.848643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1301/2629] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:25:57 2022] PUT /identity/v3/projects/8e729d2c0d7c433aa1c9537a4fae30a3/users/e9d30685355c4a68b6d95797e308ac89/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:25:57.853638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.870159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1289e-ae37-47ac-9558-be8c6f5f76fd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.922883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4eefc7-aebe-46ba-af34-13c7f952b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.923528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eefc7-aebe-46ba-af34-13c7f952b973 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.923809 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eefc7-aebe-46ba-af34-13c7f952b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.924083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4eefc7-aebe-46ba-af34-13c7f952b973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.924804 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4eefc7-aebe-46ba-af34-13c7f952b973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.926408 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4eefc7-aebe-46ba-af34-13c7f952b973 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.935774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1329/2630] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:25:57.939757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:57.949870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b999e3-53ac-4682-9ee0-4a3751cc8006 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:57.954399 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:57.955252 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.955530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.955801 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] PATH_INFO: `/v3/projects/8e729d2c0d7c433aa1c9537a4fae30a3/users/e9d30685355c4a68b6d95797e308ac89/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:57.957786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e729d2c0d7c433aa1c9537a4fae30a3, user_id=e9d30685355c4a68b6d95797e308ac89, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:57.960860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:57.970545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1302/2631] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:25:57 2022] PUT /identity/v3/projects/8e729d2c0d7c433aa1c9537a4fae30a3/users/e9d30685355c4a68b6d95797e308ac89/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:57.982248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce1e4-3204-4163-91ef-18d292b882aa None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:57.982542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce1e4-3204-4163-91ef-18d292b882aa None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:57.982828 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce1e4-3204-4163-91ef-18d292b882aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:58.008766 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-bd7ce1e4-3204-4163-91ef-18d292b882aa None None] MFA Rules not processed for user `e9d30685355c4a68b6d95797e308ac89`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:58.010079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bd7ce1e4-3204-4163-91ef-18d292b882aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:58.074259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1330/2632] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:58.084694 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:58.089357 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:58.139942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57d400-f93d-4864-bc18-992ae27f1366 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:58.143490 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ab11-a4b5-4276-a4d5-85316409805b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:58.144112 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ab11-a4b5-4276-a4d5-85316409805b service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:58.144395 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ab11-a4b5-4276-a4d5-85316409805b service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:58.144668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ab11-a4b5-4276-a4d5-85316409805b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:58.153798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ab11-a4b5-4276-a4d5-85316409805b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:58.155207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ab11-a4b5-4276-a4d5-85316409805b service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:58.164790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1303/2633] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:25:59.029658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce1e4-3204-4163-91ef-18d292b882aa None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:59.089602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce1e4-3204-4163-91ef-18d292b882aa None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:59.094077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:59.095008 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:59.095295 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:59.095567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] PATH_INFO: `/v3/users/d86c52c0cd0b4525af944dcd98380013` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:59.096750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86c52c0cd0b4525af944dcd98380013)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:59.099192 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:59.255946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86c52c0cd0b4525af944dcd98380013'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:59.256609 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86c52c0cd0b4525af944dcd98380013'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:59.268134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86c52c0cd0b4525af944dcd98380013'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:59.332929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86c52c0cd0b4525af944dcd98380013'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:59.333591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86c52c0cd0b4525af944dcd98380013'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:25:59.345995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1331/2634] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:25:59 2022] DELETE /identity/v3/users/d86c52c0cd0b4525af944dcd98380013 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:25:59.350571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:59.351058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:59.351158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:59.368971 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:59.370205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:59.429358 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1304/2635] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:59.439094 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:59.440495 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:59.495311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90032f0-28ce-42c6-8eb5-06547be6255f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:59.498952 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:59.499582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:59.499864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:59.500141 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:59.509551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:59.510968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:59.520131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1332/2636] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:59.947707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:59.949175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:59.966478 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6fd6f-a3c8-4723-8b3b-8beb3fb9e94e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:59.967797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:59.968637 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:59.968914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:59.969188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] PATH_INFO: `/v3/projects/779a8f846b4b47e2bb24543b7a6ab2c7` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:59.970455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779a8f846b4b47e2bb24543b7a6ab2c7)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:59.972359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:00.139957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779a8f846b4b47e2bb24543b7a6ab2c7', 'request_id': 'req-81b21317-521e-47c7-a409-7e6618e52f26'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.243099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779a8f846b4b47e2bb24543b7a6ab2c7', 'request_id': 'req-81b21317-521e-47c7-a409-7e6618e52f26'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.249404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779a8f846b4b47e2bb24543b7a6ab2c7', 'request_id': 'req-81b21317-521e-47c7-a409-7e6618e52f26'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.259861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] The token cache is being invalidate because project 779a8f846b4b47e2bb24543b7a6ab2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:00.260152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.260775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.262402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1305/2637] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:25:59 2022] DELETE /identity/v3/projects/779a8f846b4b47e2bb24543b7a6ab2c7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:00.268906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:00.275788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b2a28-bd6e-4e75-badd-940bf312216e service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:00.330829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:00.331680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:00.331960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:00.332233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] PATH_INFO: `/v3/users/e9d30685355c4a68b6d95797e308ac89` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:00.333479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d30685355c4a68b6d95797e308ac89)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:00.335377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:00.489316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d30685355c4a68b6d95797e308ac89'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.490594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d30685355c4a68b6d95797e308ac89'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.503284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d30685355c4a68b6d95797e308ac89'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.570085 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d30685355c4a68b6d95797e308ac89'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.570707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0d44d825-97d8-4de1-b147-4578c7355f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d30685355c4a68b6d95797e308ac89'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:00.582995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1333/2638] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:00 2022] DELETE /identity/v3/users/e9d30685355c4a68b6d95797e308ac89 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:01.022351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:01.023648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:01.038840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b21317-521e-47c7-a409-7e6618e52f26 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:01.094541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:01.095380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.095654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.095919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] PATH_INFO: `/v3/projects/8e729d2c0d7c433aa1c9537a4fae30a3` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.097086 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e729d2c0d7c433aa1c9537a4fae30a3)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:01.099612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:01.225800 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e729d2c0d7c433aa1c9537a4fae30a3', 'request_id': 'req-13d446d8-cf81-493d-87a6-18c1beefb099'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:01.294309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e729d2c0d7c433aa1c9537a4fae30a3', 'request_id': 'req-13d446d8-cf81-493d-87a6-18c1beefb099'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:01.301149 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e729d2c0d7c433aa1c9537a4fae30a3', 'request_id': 'req-13d446d8-cf81-493d-87a6-18c1beefb099'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:01.311101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] The token cache is being invalidate because project 8e729d2c0d7c433aa1c9537a4fae30a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:01.311385 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:01.311995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-13d446d8-cf81-493d-87a6-18c1beefb099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:01.313693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1306/2639] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:01 2022] DELETE /identity/v3/projects/8e729d2c0d7c433aa1c9537a4fae30a3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:01.319473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5427-71aa-4b3a-93fc-a47b83d6f40f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.319950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5427-71aa-4b3a-93fc-a47b83d6f40f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.320062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5427-71aa-4b3a-93fc-a47b83d6f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.338436 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-1beb5427-71aa-4b3a-93fc-a47b83d6f40f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:01.339622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1beb5427-71aa-4b3a-93fc-a47b83d6f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:01.396658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1334/2640] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:01.404131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fce1d-3a51-42aa-b6f7-cfc1dfab422f None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.404394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fce1d-3a51-42aa-b6f7-cfc1dfab422f None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.407683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fce1d-3a51-42aa-b6f7-cfc1dfab422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.422499 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b59fce1d-3a51-42aa-b6f7-cfc1dfab422f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:01.423881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b59fce1d-3a51-42aa-b6f7-cfc1dfab422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:01.431946 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1307/2641] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:01.437010 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5427-71aa-4b3a-93fc-a47b83d6f40f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:01.447478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5427-71aa-4b3a-93fc-a47b83d6f40f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:01.452209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:01.452849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.453125 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.453433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.454168 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:01.454475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:01.456048 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:01.468519 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1335/2642] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:01.472798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fce1d-3a51-42aa-b6f7-cfc1dfab422f None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:01.482102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fce1d-3a51-42aa-b6f7-cfc1dfab422f None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:01.487146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:01.487814 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.488089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.488365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.489085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:01.491046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:01.579764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1308/2643] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:01 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:01.583872 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:01.593695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e2fe-4ae5-46b9-a8a5-fd4253c35c94 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:01.648040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:01.648694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.648981 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.649260 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.650080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:01.651998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:01.738813 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1336/2644] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:01 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:01.743312 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:01.753526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5f1b0-1070-4af2-8ecc-c875a44b0d6a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:01.759793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:01.760569 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.760921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.761257 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.762145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:01.764014 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:01.774666 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1309/2645] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:01.778763 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:01.788750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b68a4-46e3-44cf-9c12-947e8eda9f20 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:01.793530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d1a65-da4d-4ccd-9d80-fa79b600db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:01.794181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1a65-da4d-4ccd-9d80-fa79b600db05 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.794528 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1a65-da4d-4ccd-9d80-fa79b600db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.794808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1a65-da4d-4ccd-9d80-fa79b600db05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.795541 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d1a65-da4d-4ccd-9d80-fa79b600db05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:01.797200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d1a65-da4d-4ccd-9d80-fa79b600db05 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:01.810751 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1337/2646] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:01.811937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:01.823682 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacb064-0132-4559-bb7d-773cda5e1502 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:01.828677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:01.829437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.829718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.831872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] PATH_INFO: `/v3/projects/5936655430d64a959744206ec76bac11/users/3fa67ccf0e5c45c5b1ee6dcfe63b32ed/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.849260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5936655430d64a959744206ec76bac11, user_id=3fa67ccf0e5c45c5b1ee6dcfe63b32ed, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:01.851903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:01.933889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1310/2647] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:01 2022] PUT /identity/v3/projects/5936655430d64a959744206ec76bac11/users/3fa67ccf0e5c45c5b1ee6dcfe63b32ed/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:01.944151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7115-aa9d-476c-8ea4-df60b5c9fa87 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:01.944441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7115-aa9d-476c-8ea4-df60b5c9fa87 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:01.944798 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7115-aa9d-476c-8ea4-df60b5c9fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:01.970874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-588a7115-aa9d-476c-8ea4-df60b5c9fa87 None None] MFA Rules not processed for user `3fa67ccf0e5c45c5b1ee6dcfe63b32ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:01.972268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-588a7115-aa9d-476c-8ea4-df60b5c9fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:02.034584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1338/2648] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:02.039665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.105370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daca65-faaa-4b96-a673-e36f5b24c74d admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.110222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.110862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.111146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.111422 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.112128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:02.114051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:02.204267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1311/2649] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:02 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:02.208433 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a7115-aa9d-476c-8ea4-df60b5c9fa87 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.219362 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a7115-aa9d-476c-8ea4-df60b5c9fa87 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.275530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.276247 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.276540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.276801 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.277542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:02.279468 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:02.346514 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1339/2650] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:02 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:02.350935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.361605 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b594d4-1fa8-4904-b1c1-1e2aef3af2a9 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.366223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.366877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.367156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.367433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.368166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:02.369807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:02.380253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1312/2651] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:02.384345 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.394379 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2b1a6-66b2-4689-8d27-487b82829ce4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.399733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.400703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.401046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.401427 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] PATH_INFO: `/v3/projects/3695bc20bd364acc97aa3a7aad4276f1/users/52cf0177a76842cb928d1eda2d48c90c/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.416827 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3695bc20bd364acc97aa3a7aad4276f1, user_id=52cf0177a76842cb928d1eda2d48c90c, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:02.419905 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:02.500716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1340/2652] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:02 2022] PUT /identity/v3/projects/3695bc20bd364acc97aa3a7aad4276f1/users/52cf0177a76842cb928d1eda2d48c90c/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:02.504706 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.514402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eff2a-e81b-4dc5-9348-cde1206a28dd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.568732 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6850f-05b1-413e-aa67-8d5b68935e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.569417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6850f-05b1-413e-aa67-8d5b68935e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.569698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6850f-05b1-413e-aa67-8d5b68935e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.569966 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6850f-05b1-413e-aa67-8d5b68935e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.570688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6850f-05b1-413e-aa67-8d5b68935e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:02.572375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6850f-05b1-413e-aa67-8d5b68935e39 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:02.581658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1313/2653] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:02.586253 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.596212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455cec-a1df-443e-b11b-763f278a66ad admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.601507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.602366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.602647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.602929 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] PATH_INFO: `/v3/projects/3695bc20bd364acc97aa3a7aad4276f1/users/52cf0177a76842cb928d1eda2d48c90c/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.604906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3695bc20bd364acc97aa3a7aad4276f1, user_id=52cf0177a76842cb928d1eda2d48c90c, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:02.607556 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:02.617757 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1341/2654] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:02 2022] PUT /identity/v3/projects/3695bc20bd364acc97aa3a7aad4276f1/users/52cf0177a76842cb928d1eda2d48c90c/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:02.628407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.628689 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.628969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.655421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] MFA Rules not processed for user `52cf0177a76842cb928d1eda2d48c90c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:02.656650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:02.720650 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1314/2655] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:02.730593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.732235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:02.788687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe8716-ea79-40e9-a4d3-0483f2bc9b20 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.792418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.793055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.793367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.793642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.802649 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:02.804059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:02.813095 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1342/2656] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:02.929769 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:02.931124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:02.943283 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c8d87-fd2e-4bbc-a8cc-f28296aca161 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:02.946824 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad64a78-5154-4c6f-ab32-da7aa8498ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:02.947447 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64a78-5154-4c6f-ab32-da7aa8498ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.947723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64a78-5154-4c6f-ab32-da7aa8498ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.947991 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64a78-5154-4c6f-ab32-da7aa8498ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:03.000428 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad64a78-5154-4c6f-ab32-da7aa8498ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:03.001872 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad64a78-5154-4c6f-ab32-da7aa8498ba6 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:03.010969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1315/2657] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:07.968367 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:08.029749 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd2c01-bddc-45b8-b7c4-5d1d708cbac1 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:08.034265 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:08.035115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:08.035397 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:08.035673 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] PATH_INFO: `/v3/users/3fa67ccf0e5c45c5b1ee6dcfe63b32ed` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:08.037462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa67ccf0e5c45c5b1ee6dcfe63b32ed)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:08.039350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:08.216679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa67ccf0e5c45c5b1ee6dcfe63b32ed'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:08.217366 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa67ccf0e5c45c5b1ee6dcfe63b32ed'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:08.229788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa67ccf0e5c45c5b1ee6dcfe63b32ed'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:08.321434 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa67ccf0e5c45c5b1ee6dcfe63b32ed'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:08.322053 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa67ccf0e5c45c5b1ee6dcfe63b32ed'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:08.335067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1343/2658] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:07 2022] DELETE /identity/v3/users/3fa67ccf0e5c45c5b1ee6dcfe63b32ed => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:08.339555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:08.340025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:08.340124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:08.357576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:08.358744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:08.413857 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1316/2659] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:08.423768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:08.425068 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:08.481655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755165-aef8-49dc-9d88-91535f77bb45 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:08.485578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:08.486212 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:08.486498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:08.486775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:08.495759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:08.497194 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:08.506523 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1344/2660] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:08.872763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:08.874275 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:08.886790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421a52-f543-432f-a919-1a341b4634f8 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:08.891527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:08.892368 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:08.892649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:08.892975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] PATH_INFO: `/v3/projects/5936655430d64a959744206ec76bac11` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:08.894296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5936655430d64a959744206ec76bac11)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:08.896875 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:08.996961 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5936655430d64a959744206ec76bac11', 'request_id': 'req-e1f44c93-7dee-4919-9bcc-412248a9d7ca'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.083030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5936655430d64a959744206ec76bac11', 'request_id': 'req-e1f44c93-7dee-4919-9bcc-412248a9d7ca'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.089668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5936655430d64a959744206ec76bac11', 'request_id': 'req-e1f44c93-7dee-4919-9bcc-412248a9d7ca'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.099970 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] The token cache is being invalidate because project 5936655430d64a959744206ec76bac11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:09.100263 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.100910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.102455 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1317/2661] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:08 2022] DELETE /identity/v3/projects/5936655430d64a959744206ec76bac11 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:09.106579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:09.116818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5033ff-3e7e-4ff7-b256-6544c96b6641 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:09.169807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:09.170647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:09.170954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:09.171227 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] PATH_INFO: `/v3/users/52cf0177a76842cb928d1eda2d48c90c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:09.172402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cf0177a76842cb928d1eda2d48c90c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:09.174333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:09.322022 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:09.323391 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:09.336457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cf0177a76842cb928d1eda2d48c90c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.341322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cf0177a76842cb928d1eda2d48c90c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.348539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cf0177a76842cb928d1eda2d48c90c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.376983 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f44c93-7dee-4919-9bcc-412248a9d7ca admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:09.381114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:09.381771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:09.382048 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:09.382322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:09.384073 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:09.395328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:09.396786 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:09.406052 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1318/2662] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:09.419011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cf0177a76842cb928d1eda2d48c90c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.419675 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-845bb60a-2b8f-4ad0-ade8-189197fe1aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cf0177a76842cb928d1eda2d48c90c'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:09.433738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1345/2663] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:09 2022] DELETE /identity/v3/users/52cf0177a76842cb928d1eda2d48c90c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:10.004477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:10.006019 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:10.023178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8ecdf-18d1-4209-b4b8-e98be87bb349 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:10.078390 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:10.079426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.080362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.080362 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] PATH_INFO: `/v3/projects/3695bc20bd364acc97aa3a7aad4276f1` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.081397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3695bc20bd364acc97aa3a7aad4276f1)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:10.083838 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:10.207475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3695bc20bd364acc97aa3a7aad4276f1', 'request_id': 'req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:10.269986 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3695bc20bd364acc97aa3a7aad4276f1', 'request_id': 'req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:10.277371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3695bc20bd364acc97aa3a7aad4276f1', 'request_id': 'req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:10.288625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] The token cache is being invalidate because project 3695bc20bd364acc97aa3a7aad4276f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:10.288914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:10.289603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f1f6a89b-8d6d-4de6-a7db-10fcf39530aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:10.291114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1319/2664] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:10 2022] DELETE /identity/v3/projects/3695bc20bd364acc97aa3a7aad4276f1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:10.296126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ed18-5604-4550-8e02-52b35491ce5a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.296614 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ed18-5604-4550-8e02-52b35491ce5a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.296723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ed18-5604-4550-8e02-52b35491ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.314470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5280ed18-5604-4550-8e02-52b35491ce5a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:10.315663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5280ed18-5604-4550-8e02-52b35491ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:10.374637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1346/2665] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:10.383208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8215f-e6d0-48bd-9065-a1c46728e8fb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.383680 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8215f-e6d0-48bd-9065-a1c46728e8fb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.383778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8215f-e6d0-48bd-9065-a1c46728e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.402304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f0c8215f-e6d0-48bd-9065-a1c46728e8fb None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:10.403493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f0c8215f-e6d0-48bd-9065-a1c46728e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:10.411230 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1320/2666] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:10.415417 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ed18-5604-4550-8e02-52b35491ce5a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:10.424848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ed18-5604-4550-8e02-52b35491ce5a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:10.429627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:10.430288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.430566 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.430837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.431568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:10.431874 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:10.433493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:10.445245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1347/2667] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:10.449394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8215f-e6d0-48bd-9065-a1c46728e8fb None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:10.459003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8215f-e6d0-48bd-9065-a1c46728e8fb None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:10.463681 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:10.464317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.464596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.464869 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.465606 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:10.467673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:10.554796 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1321/2668] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:10 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:10.558287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:10.569723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29be7-9162-47e2-bca4-709225cdebf0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:10.633695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:10.634278 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.634560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.634836 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.635618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:10.637557 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:10.745613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1348/2669] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:10 2022] POST /identity/v3/users => generated 304 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:10.749700 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:10.760264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5541e0-2526-4257-a80d-b0ee7fbc767f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:10.764840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:10.765518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.765798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.766068 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.766822 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:10.768456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:10.778998 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1322/2670] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:10.782575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:10.792511 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296185d3-b90d-422e-a1d0-7b4b4b43bdfd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:10.797112 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc5454-bbb3-40c5-b123-f711c5167ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:10.797790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc5454-bbb3-40c5-b123-f711c5167ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.798072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc5454-bbb3-40c5-b123-f711c5167ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.798346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc5454-bbb3-40c5-b123-f711c5167ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.799075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc5454-bbb3-40c5-b123-f711c5167ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:10.800680 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc5454-bbb3-40c5-b123-f711c5167ce5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:10.811313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1349/2671] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:10.815471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:10.826053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9000-1307-46ec-be51-78c64d604831 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:10.830615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:10.831474 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.831774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.832043 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] PATH_INFO: `/v3/projects/6a5459b16f184e81a23aa3a986218ac1/users/2f80e2c829254816acb27f24850fe6a3/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:10.847075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5459b16f184e81a23aa3a986218ac1, user_id=2f80e2c829254816acb27f24850fe6a3, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:10.849745 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:10.967440 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1323/2672] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:10 2022] PUT /identity/v3/projects/6a5459b16f184e81a23aa3a986218ac1/users/2f80e2c829254816acb27f24850fe6a3/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:10.978992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30562cf-4df1-4a96-87ea-9198a2afd7fd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:10.979290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30562cf-4df1-4a96-87ea-9198a2afd7fd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:10.979656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30562cf-4df1-4a96-87ea-9198a2afd7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.018816 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-e30562cf-4df1-4a96-87ea-9198a2afd7fd None None] MFA Rules not processed for user `2f80e2c829254816acb27f24850fe6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:11.020030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e30562cf-4df1-4a96-87ea-9198a2afd7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:11.093092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1350/2673] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:11.097584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.168268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05b8c-c0a0-46ff-bbee-04f09b9a7627 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:11.173491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:11.174371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.174761 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.175099 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.175944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:11.178025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:11.274432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1324/2674] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:11 2022] POST /identity/v3/projects => generated 407 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:11.278575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30562cf-4df1-4a96-87ea-9198a2afd7fd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.293785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30562cf-4df1-4a96-87ea-9198a2afd7fd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:11.355369 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:11.356088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.356318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.356622 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.357374 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:11.359304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:11.462082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1351/2675] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:11 2022] POST /identity/v3/users => generated 310 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:11.466734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.488297 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f3f5d-1073-4f3c-ae3c-a74497829a21 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:11.493545 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:11.494200 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.494479 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.494749 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.495477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:11.497055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:11.508096 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1325/2676] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:11.512903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.523774 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fb379-a2b5-49a9-84bc-8dcb69430dd8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:11.529243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:11.530241 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.530522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.530864 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] PATH_INFO: `/v3/projects/2d1e0f22abcf44c7afcdb028c372c993/users/2fbbf93a22634cee92fa15041c47ee22/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.546503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1e0f22abcf44c7afcdb028c372c993, user_id=2fbbf93a22634cee92fa15041c47ee22, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:11.549165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:11.644817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1352/2677] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:11 2022] PUT /identity/v3/projects/2d1e0f22abcf44c7afcdb028c372c993/users/2fbbf93a22634cee92fa15041c47ee22/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:11.648849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.660377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc851ce-9c77-4ee9-97b5-bc8ecd7e4def admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:11.732334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b352aa-cc1a-44e2-9c27-72797dfcaf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:11.733710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b352aa-cc1a-44e2-9c27-72797dfcaf6f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.733999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b352aa-cc1a-44e2-9c27-72797dfcaf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.734276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b352aa-cc1a-44e2-9c27-72797dfcaf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.735421 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b352aa-cc1a-44e2-9c27-72797dfcaf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:11.737072 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b352aa-cc1a-44e2-9c27-72797dfcaf6f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:11.748020 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1326/2678] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:11.751948 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.762264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc717ac1-04fc-487b-a754-14196ae241d4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:11.767199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:11.768107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.768361 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.768632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] PATH_INFO: `/v3/projects/2d1e0f22abcf44c7afcdb028c372c993/users/2fbbf93a22634cee92fa15041c47ee22/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.771619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1e0f22abcf44c7afcdb028c372c993, user_id=2fbbf93a22634cee92fa15041c47ee22, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:11.774302 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:11.793330 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1353/2679] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:11 2022] PUT /identity/v3/projects/2d1e0f22abcf44c7afcdb028c372c993/users/2fbbf93a22634cee92fa15041c47ee22/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:11.797231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59d326-1e64-4914-b87f-d9bff25dd1cc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.797464 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59d326-1e64-4914-b87f-d9bff25dd1cc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.797710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59d326-1e64-4914-b87f-d9bff25dd1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.824192 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1f59d326-1e64-4914-b87f-d9bff25dd1cc None None] MFA Rules not processed for user `2fbbf93a22634cee92fa15041c47ee22`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:11.825587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1f59d326-1e64-4914-b87f-d9bff25dd1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:11.892260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1327/2680] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:11.901837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.903561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:11.961787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cddf2e-94eb-47b5-99da-d6b679f03daf admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:11.965454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:11.966127 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.966421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.966699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.976170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:11.977611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:11.986993 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1354/2681] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:12.310846 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59d326-1e64-4914-b87f-d9bff25dd1cc None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:12.322141 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59d326-1e64-4914-b87f-d9bff25dd1cc None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:12.326693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:12.326693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:12.326693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:12.326693 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:12.388855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:12.390456 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:12.400902 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1328/2682] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:13.380759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:13.382242 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:13.444995 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96df5b-bfb0-40f0-bce4-7928f546d8b4 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:13.449594 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:13.450454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:13.450735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:13.451011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] PATH_INFO: `/v3/users/86560704b2374f75bc32b19475b63462` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:13.452219 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86560704b2374f75bc32b19475b63462)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:13.454170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:13.621185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86560704b2374f75bc32b19475b63462'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:13.621876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86560704b2374f75bc32b19475b63462'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:13.633373 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86560704b2374f75bc32b19475b63462'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:13.705492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86560704b2374f75bc32b19475b63462'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:13.706170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-0afedfdb-c5c0-40eb-a35f-aa91fef48c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86560704b2374f75bc32b19475b63462'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:13.719163 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1355/2683] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:13 2022] DELETE /identity/v3/users/86560704b2374f75bc32b19475b63462 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:13.976178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:13.987819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033464-6081-4178-bedb-2ea98ecbefaa service cinder] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:14.041550 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:14.042406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.042683 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.042953 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] PATH_INFO: `/v3/projects/f5a7d98ea94e4547983dbffcb2b614bc` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.044121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a7d98ea94e4547983dbffcb2b614bc)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:14.046039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:14.174239 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a7d98ea94e4547983dbffcb2b614bc', 'request_id': 'req-de925fe3-a849-4689-979a-22cf99c931ba'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:14.288943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a7d98ea94e4547983dbffcb2b614bc', 'request_id': 'req-de925fe3-a849-4689-979a-22cf99c931ba'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:14.295655 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a7d98ea94e4547983dbffcb2b614bc', 'request_id': 'req-de925fe3-a849-4689-979a-22cf99c931ba'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:14.305444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] The token cache is being invalidate because project f5a7d98ea94e4547983dbffcb2b614bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:14.305729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:14.306352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-de925fe3-a849-4689-979a-22cf99c931ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:14.307851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1329/2684] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:13 2022] DELETE /identity/v3/projects/f5a7d98ea94e4547983dbffcb2b614bc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:14.312628 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe411-0333-4930-a4cc-a1f6272190d1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.312907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe411-0333-4930-a4cc-a1f6272190d1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.313180 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfe411-0333-4930-a4cc-a1f6272190d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.330615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-bbbfe411-0333-4930-a4cc-a1f6272190d1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:14.331791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bbbfe411-0333-4930-a4cc-a1f6272190d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:14.387990 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1356/2685] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:14.396265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288398-e868-478a-b126-91de78ccf6e4 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.396561 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288398-e868-478a-b126-91de78ccf6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.396866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f288398-e868-478a-b126-91de78ccf6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.415261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2f288398-e868-478a-b126-91de78ccf6e4 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:14.416444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2f288398-e868-478a-b126-91de78ccf6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:14.424296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1330/2686] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:14.428387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfe411-0333-4930-a4cc-a1f6272190d1 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:14.437765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfe411-0333-4930-a4cc-a1f6272190d1 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:14.442551 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:14.443267 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.443549 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.443825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.444555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:14.444861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:14.446492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:14.457784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1357/2687] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:14.462458 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288398-e868-478a-b126-91de78ccf6e4 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:14.471426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f288398-e868-478a-b126-91de78ccf6e4 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:14.476660 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:14.477296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.477591 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.477868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.478563 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:14.480429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:14.619871 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1331/2688] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:14 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:14.624151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:14.634555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bb09-7fbf-432f-a240-aacea25b240c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:14.688691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:14.689381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.689664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.690003 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.690703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:14.692638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:14.763866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1358/2689] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:14 2022] POST /identity/v3/users => generated 282 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:14.767775 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:14.778581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23936635-2381-4c56-853a-584fa237c0db admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:14.783147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:14.783817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.784095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.784414 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.785124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:14.786757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:14.797304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1332/2690] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:14.801263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:14.811696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e302-61df-4fda-a93c-48faff75a2a7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:14.816439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2495c-e6f2-4174-80b1-0a1fbd8448e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:14.817118 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2495c-e6f2-4174-80b1-0a1fbd8448e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.817435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2495c-e6f2-4174-80b1-0a1fbd8448e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.818259 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2495c-e6f2-4174-80b1-0a1fbd8448e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.819080 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2495c-e6f2-4174-80b1-0a1fbd8448e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:14.820695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2495c-e6f2-4174-80b1-0a1fbd8448e5 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:14.830833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1359/2691] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:14.837310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:14.846922 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7d215-50f6-478c-a849-b10228e1d409 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:14.851544 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:14.852396 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.852722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.852997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] PATH_INFO: `/v3/projects/51cd7099070c4da8a3a3d6fc06fbac92/users/d16c3ffb6af2480aad82751d642dd963/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.867317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cd7099070c4da8a3a3d6fc06fbac92, user_id=d16c3ffb6af2480aad82751d642dd963, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:14.871616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:14.957482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1333/2692] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:14 2022] PUT /identity/v3/projects/51cd7099070c4da8a3a3d6fc06fbac92/users/d16c3ffb6af2480aad82751d642dd963/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:14.968039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4dd5f-3d99-4b7a-a17d-ef45cf477efb None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:14.968344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4dd5f-3d99-4b7a-a17d-ef45cf477efb None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:14.968637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4dd5f-3d99-4b7a-a17d-ef45cf477efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:14.994493 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4ef4dd5f-3d99-4b7a-a17d-ef45cf477efb None None] MFA Rules not processed for user `d16c3ffb6af2480aad82751d642dd963`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:14.995697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4ef4dd5f-3d99-4b7a-a17d-ef45cf477efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:15.061972 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1360/2693] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:15.065260 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.127865 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21bf03-611f-4a26-b0ee-ec6f84c7e68c admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.133571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.134271 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.134549 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.134818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.135556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.137520 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.262509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1334/2694] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:15 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:15.266475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4dd5f-3d99-4b7a-a17d-ef45cf477efb None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.277156 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4dd5f-3d99-4b7a-a17d-ef45cf477efb None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.331037 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.331694 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.331976 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.332252 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.332956 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.334897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.454176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1361/2695] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:15 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:15.458183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.468518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37a68-3798-4b1c-bdf1-462786579258 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.473152 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.473821 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.474100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.474864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.475589 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.477159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.487415 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1335/2696] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:15.492281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.501968 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27194-6e20-4520-b3c5-bf8bee271e34 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.506465 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.507318 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.507597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.507871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] PATH_INFO: `/v3/projects/07051edb100a4077928554b328588c22/users/b43e2f1f761c49d99113afcb52f1b4fe/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.521960 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07051edb100a4077928554b328588c22, user_id=b43e2f1f761c49d99113afcb52f1b4fe, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.524574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.603029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1362/2697] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:15 2022] PUT /identity/v3/projects/07051edb100a4077928554b328588c22/users/b43e2f1f761c49d99113afcb52f1b4fe/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:15.607056 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.617619 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2e7b4-e67e-4f95-b75e-d81f97ac7a25 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.669575 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ba2fb-bf73-4a6b-9a3b-d18fc6c28c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.670232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba2fb-bf73-4a6b-9a3b-d18fc6c28c6d admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.670510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba2fb-bf73-4a6b-9a3b-d18fc6c28c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.670781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba2fb-bf73-4a6b-9a3b-d18fc6c28c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.671532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ba2fb-bf73-4a6b-9a3b-d18fc6c28c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.673144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ba2fb-bf73-4a6b-9a3b-d18fc6c28c6d admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.683382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1336/2698] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:15.687606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.698845 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c74b-70ce-427d-82be-05d3d850a88f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.703480 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.704411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.704632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.704903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] PATH_INFO: `/v3/projects/07051edb100a4077928554b328588c22/users/b43e2f1f761c49d99113afcb52f1b4fe/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.706950 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07051edb100a4077928554b328588c22, user_id=b43e2f1f761c49d99113afcb52f1b4fe, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.709601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.719683 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1363/2699] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:15 2022] PUT /identity/v3/projects/07051edb100a4077928554b328588c22/users/b43e2f1f761c49d99113afcb52f1b4fe/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:15.731030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df463-e7e0-4fea-bf3a-6807de0db246 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.731310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df463-e7e0-4fea-bf3a-6807de0db246 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.731607 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df463-e7e0-4fea-bf3a-6807de0db246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.758612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-2f0df463-e7e0-4fea-bf3a-6807de0db246 None None] MFA Rules not processed for user `b43e2f1f761c49d99113afcb52f1b4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:15.759862 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2f0df463-e7e0-4fea-bf3a-6807de0db246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:15.824582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1337/2700] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:15 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:15.835073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.836837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:15.891645 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6591dee-774c-432a-b6f8-7180eeaecb4d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.895510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.896808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.897098 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.897602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.906648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.908059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.918264 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1364/2701] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:16.107119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0df463-e7e0-4fea-bf3a-6807de0db246 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:16.116915 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0df463-e7e0-4fea-bf3a-6807de0db246 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:16.120654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d7623-7e8b-4dc9-90d5-a51dcdf6acd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:16.121350 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7623-7e8b-4dc9-90d5-a51dcdf6acd9 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:16.122316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7623-7e8b-4dc9-90d5-a51dcdf6acd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:16.122316 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7623-7e8b-4dc9-90d5-a51dcdf6acd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:16.176765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d7623-7e8b-4dc9-90d5-a51dcdf6acd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:16.178304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d7623-7e8b-4dc9-90d5-a51dcdf6acd9 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:16.187525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1338/2702] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:24.729439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:24.730897 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:24.795077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5a67-0dc9-420f-8483-63fed9bad9f8 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:24.799563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:24.800457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:24.800731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:24.800998 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] PATH_INFO: `/v3/users/2f80e2c829254816acb27f24850fe6a3` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:24.802213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f80e2c829254816acb27f24850fe6a3)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:24.804215 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:25.124839 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f80e2c829254816acb27f24850fe6a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:25.125522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f80e2c829254816acb27f24850fe6a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:25.137464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f80e2c829254816acb27f24850fe6a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:25.219753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f80e2c829254816acb27f24850fe6a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:25.220321 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f80e2c829254816acb27f24850fe6a3'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:25.232627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1365/2703] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:24 2022] DELETE /identity/v3/users/2f80e2c829254816acb27f24850fe6a3 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:25.237570 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:25.238057 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:25.238251 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:25.255130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:25.256957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:25.315877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1339/2704] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:25.326191 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:25.327568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:25.383297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a62f9a-8892-4df0-945e-70851fd9593f admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:25.386910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:25.387537 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:25.387819 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:25.388092 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:25.397738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:25.399177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:25.408818 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1366/2705] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:25.930475 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:25.934062 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:25.944333 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48c5f-4ca9-4efe-ae6a-290ca46c1eb1 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:25.949369 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:25.950240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:25.950517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:25.951518 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] PATH_INFO: `/v3/projects/6a5459b16f184e81a23aa3a986218ac1` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:25.952889 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5459b16f184e81a23aa3a986218ac1)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:25.954933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:26.048886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5459b16f184e81a23aa3a986218ac1', 'request_id': 'req-dc131011-53b1-46ca-aaec-46e4c743934a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.132412 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5459b16f184e81a23aa3a986218ac1', 'request_id': 'req-dc131011-53b1-46ca-aaec-46e4c743934a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.138751 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5459b16f184e81a23aa3a986218ac1', 'request_id': 'req-dc131011-53b1-46ca-aaec-46e4c743934a'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.148612 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] The token cache is being invalidate because project 6a5459b16f184e81a23aa3a986218ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:26.148897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.149554 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.151045 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1340/2706] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:25 2022] DELETE /identity/v3/projects/6a5459b16f184e81a23aa3a986218ac1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:26.155027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:26.165108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1574d-5e65-4c0e-ad4d-b4e0a419c15d service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:26.218842 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:26.219688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:26.219967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:26.220238 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] PATH_INFO: `/v3/users/2fbbf93a22634cee92fa15041c47ee22` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:26.221462 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbbf93a22634cee92fa15041c47ee22)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:26.223364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:26.523658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbbf93a22634cee92fa15041c47ee22'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.524284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbbf93a22634cee92fa15041c47ee22'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.541075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbbf93a22634cee92fa15041c47ee22'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.648579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbbf93a22634cee92fa15041c47ee22'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.649195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-f7d0f029-8936-482f-b194-5497d6d53eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbbf93a22634cee92fa15041c47ee22'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:26.661575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1367/2707] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:26 2022] DELETE /identity/v3/users/2fbbf93a22634cee92fa15041c47ee22 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:27.135741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.137207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:27.150285 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131011-53b1-46ca-aaec-46e4c743934a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.214712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.215559 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.215841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.216113 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] PATH_INFO: `/v3/projects/2d1e0f22abcf44c7afcdb028c372c993` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.217322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1e0f22abcf44c7afcdb028c372c993)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:27.219203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:27.318468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1e0f22abcf44c7afcdb028c372c993', 'request_id': 'req-cbc255ae-91b3-4712-94b5-404644bb9353'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:27.402135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1e0f22abcf44c7afcdb028c372c993', 'request_id': 'req-cbc255ae-91b3-4712-94b5-404644bb9353'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:27.408403 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1e0f22abcf44c7afcdb028c372c993', 'request_id': 'req-cbc255ae-91b3-4712-94b5-404644bb9353'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:27.418419 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] The token cache is being invalidate because project 2d1e0f22abcf44c7afcdb028c372c993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:27.418699 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:27.419315 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-cbc255ae-91b3-4712-94b5-404644bb9353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:27.420833 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1341/2708] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:27 2022] DELETE /identity/v3/projects/2d1e0f22abcf44c7afcdb028c372c993 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:27.425783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf23681-d9e2-45c8-b942-6df16c658efa None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.426261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf23681-d9e2-45c8-b942-6df16c658efa None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.426377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf23681-d9e2-45c8-b942-6df16c658efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.444496 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-3bf23681-d9e2-45c8-b942-6df16c658efa None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:27.445731 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-3bf23681-d9e2-45c8-b942-6df16c658efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:27.503418 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1368/2709] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:27.512340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f7c7-950b-4d7d-ab5d-9cafc39e6bcc None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.512626 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f7c7-950b-4d7d-ab5d-9cafc39e6bcc None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.512903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f7c7-950b-4d7d-ab5d-9cafc39e6bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.531430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-cf01f7c7-950b-4d7d-ab5d-9cafc39e6bcc None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:27.532618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-cf01f7c7-950b-4d7d-ab5d-9cafc39e6bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:27.540731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1342/2710] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:27.544745 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf23681-d9e2-45c8-b942-6df16c658efa None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.554154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf23681-d9e2-45c8-b942-6df16c658efa None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.558776 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.559426 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.559868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.559966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.560692 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:27.561002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:27.562619 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:27.574629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1369/2711] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:27.579703 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f7c7-950b-4d7d-ab5d-9cafc39e6bcc None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.592163 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f7c7-950b-4d7d-ab5d-9cafc39e6bcc None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.599363 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.603704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.603704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.603704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.603704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:27.603704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:27.708173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1343/2712] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:27 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:27.712579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.722785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f96be-f00c-44d9-bb37-1f4dc17146df admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.778620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.779284 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.779567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.779843 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.780542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:27.782464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:27.849058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.850799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:27.863785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9cace-48ee-482c-ae1f-1e1fdf977707 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.869227 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.870095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.870373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.870645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] PATH_INFO: `/v3/users/d16c3ffb6af2480aad82751d642dd963` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.871826 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16c3ffb6af2480aad82751d642dd963)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:27.873963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:27.891179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1370/2713] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:27 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:27.892233 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.902043 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a4b4-90dd-42db-b0da-7e2ed852f173 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.906791 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.907440 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.907752 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.908033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.908899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:27.910529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:27.920608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1371/2714] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:27.924288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.934754 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f6d48-a73d-4b63-a2ab-9349cb8d64bd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.949901 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.950942 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.951369 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.951750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:27.952674 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:27.954581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:27.966430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1372/2715] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:27.973089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:27.982807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ede25-949b-49fa-8d08-2341e2d6f841 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:27.988147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a1799-2d38-4204-a390-2abedd4f9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:27.989028 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1799-2d38-4204-a390-2abedd4f9a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:27.989336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1799-2d38-4204-a390-2abedd4f9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:27.989632 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a1799-2d38-4204-a390-2abedd4f9a7a admin admin] PATH_INFO: `/v3/projects/64cfc0bb637348d8ac2537b4710e9727/users/3670561ad4ea4b2a9c40935c7231eeea/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.004891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1799-2d38-4204-a390-2abedd4f9a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cfc0bb637348d8ac2537b4710e9727, user_id=3670561ad4ea4b2a9c40935c7231eeea, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:28.010164 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a1799-2d38-4204-a390-2abedd4f9a7a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:28.067094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16c3ffb6af2480aad82751d642dd963'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:28.067770 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16c3ffb6af2480aad82751d642dd963'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:28.113331 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1373/2716] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:27 2022] PUT /identity/v3/projects/64cfc0bb637348d8ac2537b4710e9727/users/3670561ad4ea4b2a9c40935c7231eeea/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:28.118248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.118608 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.118955 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.146130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] MFA Rules not processed for user `3670561ad4ea4b2a9c40935c7231eeea`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:28.147355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:28.174468 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16c3ffb6af2480aad82751d642dd963'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:28.189122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16c3ffb6af2480aad82751d642dd963'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:28.189858 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-aea97370-2a0a-427a-b0a8-b2706434fa06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16c3ffb6af2480aad82751d642dd963'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:28.203100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1344/2717] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:27 2022] DELETE /identity/v3/users/d16c3ffb6af2480aad82751d642dd963 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:28.207727 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.208461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.208461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.219650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1374/2718] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:28.230613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:28.231511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:28.232029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:28.232893 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:28.294316 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc600053-d1b1-4fd6-accb-1df423dc9cea None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:28.315262 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1345/2719] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:28.328546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:28.331189 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:28.351441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:28.352388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.352965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.353250 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.390501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71554bb0-7a2b-432c-9d34-a1bb96d9d187 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:28.394182 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:28.394823 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.395104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.395380 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.406090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:28.407540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:28.416498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:28.417931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1346/2720] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:28.418079 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:28.428552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1375/2721] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:28.868517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:28.868517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:28.876282 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6569b-ec02-4160-9731-78d228c10914 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:28.881724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:28.882572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.883188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.883188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] PATH_INFO: `/v3/projects/51cd7099070c4da8a3a3d6fc06fbac92` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.884388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51cd7099070c4da8a3a3d6fc06fbac92)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:28.886319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:28.992039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51cd7099070c4da8a3a3d6fc06fbac92', 'request_id': 'req-7ea40754-81cb-4fac-ada5-3cb768e9ec03'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.076632 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51cd7099070c4da8a3a3d6fc06fbac92', 'request_id': 'req-7ea40754-81cb-4fac-ada5-3cb768e9ec03'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.083351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51cd7099070c4da8a3a3d6fc06fbac92', 'request_id': 'req-7ea40754-81cb-4fac-ada5-3cb768e9ec03'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.093715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] The token cache is being invalidate because project 51cd7099070c4da8a3a3d6fc06fbac92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:29.094011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.094649 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.096179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1347/2722] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:28 2022] DELETE /identity/v3/projects/51cd7099070c4da8a3a3d6fc06fbac92 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:29.100664 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:29.111561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257430d1-a09b-47f0-b3fd-3818e10d3a39 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:29.166660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:29.167520 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:29.167799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:29.168071 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] PATH_INFO: `/v3/users/b43e2f1f761c49d99113afcb52f1b4fe` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:29.169317 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43e2f1f761c49d99113afcb52f1b4fe)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:29.171206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:29.330540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43e2f1f761c49d99113afcb52f1b4fe'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.331209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43e2f1f761c49d99113afcb52f1b4fe'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.343354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43e2f1f761c49d99113afcb52f1b4fe'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.408228 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43e2f1f761c49d99113afcb52f1b4fe'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.408848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-6d4b7bdd-2d45-4e6b-a8ec-c1f0b5ef1977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43e2f1f761c49d99113afcb52f1b4fe'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:29.422895 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1376/2723] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:29 2022] DELETE /identity/v3/users/b43e2f1f761c49d99113afcb52f1b4fe => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:29.867051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:29.868459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:29.881982 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40754-81cb-4fac-ada5-3cb768e9ec03 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:29.936343 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:29.937180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:29.937492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:29.937765 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] PATH_INFO: `/v3/projects/07051edb100a4077928554b328588c22` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:29.938963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07051edb100a4077928554b328588c22)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:29.940851 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:30.070676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07051edb100a4077928554b328588c22', 'request_id': 'req-24c87c02-4974-466d-9ce5-3660adcb049c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:30.133906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07051edb100a4077928554b328588c22', 'request_id': 'req-24c87c02-4974-466d-9ce5-3660adcb049c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:30.140597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07051edb100a4077928554b328588c22', 'request_id': 'req-24c87c02-4974-466d-9ce5-3660adcb049c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:30.151083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] The token cache is being invalidate because project 07051edb100a4077928554b328588c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:30.151375 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:30.152015 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-24c87c02-4974-466d-9ce5-3660adcb049c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:30.153584 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1348/2724] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:29 2022] DELETE /identity/v3/projects/07051edb100a4077928554b328588c22 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:30.159475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dfe14-2a07-49ea-9e9d-b34a5edecb8a None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.159873 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dfe14-2a07-49ea-9e9d-b34a5edecb8a None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.160089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dfe14-2a07-49ea-9e9d-b34a5edecb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.178699 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-4a9dfe14-2a07-49ea-9e9d-b34a5edecb8a None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:30.179967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4a9dfe14-2a07-49ea-9e9d-b34a5edecb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:30.242489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1377/2725] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:30.250232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247cd17-4368-44cd-a67f-c06e70ec372d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.250526 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247cd17-4368-44cd-a67f-c06e70ec372d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.250805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247cd17-4368-44cd-a67f-c06e70ec372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.269406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-6247cd17-4368-44cd-a67f-c06e70ec372d None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:30.270601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-6247cd17-4368-44cd-a67f-c06e70ec372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:30.278897 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1349/2726] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:30.283251 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dfe14-2a07-49ea-9e9d-b34a5edecb8a None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:30.292989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dfe14-2a07-49ea-9e9d-b34a5edecb8a None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:30.297644 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:30.298294 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.298579 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.298854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.299589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:30.299898 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:30.301531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:30.314349 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1378/2727] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:30.319058 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247cd17-4368-44cd-a67f-c06e70ec372d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:30.328003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247cd17-4368-44cd-a67f-c06e70ec372d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:30.332633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:30.333264 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.333572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.333848 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.334566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:30.336441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:30.453978 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1350/2728] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:30 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:30.457780 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:30.469213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0ff61-cf7d-4a80-bae8-c8ac3ae46b18 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:30.528275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:30.528966 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.529248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.529554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.530256 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:30.532271 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:30.631775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1379/2729] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:30 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:30.635734 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:30.646207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427b9ef-5f32-432d-8bc9-54225eefa021 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:30.651546 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:30.652195 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.652529 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.652811 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.653582 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:30.655158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:30.665232 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1351/2730] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:30.669378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:30.679750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0468-251b-430a-ac12-75b3a35b0962 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:30.684530 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357b14c-6117-48ab-8ac0-d04cc03db307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:30.685190 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357b14c-6117-48ab-8ac0-d04cc03db307 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.685539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357b14c-6117-48ab-8ac0-d04cc03db307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.685805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357b14c-6117-48ab-8ac0-d04cc03db307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.686548 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357b14c-6117-48ab-8ac0-d04cc03db307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:30.688133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357b14c-6117-48ab-8ac0-d04cc03db307 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:30.698631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1380/2731] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:30.708896 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:30.719097 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f0de0-034b-49bd-b007-3d10414db9cd admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:30.723791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:30.730441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.730441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.730441 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] PATH_INFO: `/v3/projects/439f79920dfb4e7eaf8c69503de126e9/users/4c726089ea8a41d992bf6d990231a3e7/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.740708 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] RBAC: Authorizing `identity:create_grant(project_id=439f79920dfb4e7eaf8c69503de126e9, user_id=4c726089ea8a41d992bf6d990231a3e7, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:30.743552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:30.864459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1352/2732] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:30 2022] PUT /identity/v3/projects/439f79920dfb4e7eaf8c69503de126e9/users/4c726089ea8a41d992bf6d990231a3e7/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:30.876490 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058df35-a3e5-4acd-8f87-e110bbee9da4 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:30.876783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058df35-a3e5-4acd-8f87-e110bbee9da4 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:30.877089 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058df35-a3e5-4acd-8f87-e110bbee9da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:30.904759 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-8058df35-a3e5-4acd-8f87-e110bbee9da4 None None] MFA Rules not processed for user `4c726089ea8a41d992bf6d990231a3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:30.906263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8058df35-a3e5-4acd-8f87-e110bbee9da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:30.968910 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1381/2733] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:30.973493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.032720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1707151-4931-4bfc-aa18-995ee328576b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.037416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.038054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.038336 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.038604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.039295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.041201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.140969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1353/2734] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:30 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:31.145121 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058df35-a3e5-4acd-8f87-e110bbee9da4 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.155788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058df35-a3e5-4acd-8f87-e110bbee9da4 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.212039 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.212730 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.212888 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.213161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.213900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.215859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.300088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1382/2735] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:31 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:31.304984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.315143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ecba-44d8-417a-846f-0c2ee405c0b4 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.321525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.321525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.321781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.322757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.322757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.324474 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.334913 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1354/2736] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:31.344633 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.355221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53f129-156c-41c7-8595-c4f96cd66c02 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.359883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.361000 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.361311 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.361589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] PATH_INFO: `/v3/projects/7ff0dc47d22a4f40b4ce8dc07a9e7837/users/9d0440bd23f94e9b8c79f909d8cd501b/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.381540 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff0dc47d22a4f40b4ce8dc07a9e7837, user_id=9d0440bd23f94e9b8c79f909d8cd501b, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.384182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.465415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1383/2737] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:31 2022] PUT /identity/v3/projects/7ff0dc47d22a4f40b4ce8dc07a9e7837/users/9d0440bd23f94e9b8c79f909d8cd501b/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:31.469100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.479611 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdc3f5-4ed4-4af1-9976-de09a8bf9a13 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.488225 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.490025 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:31.534876 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.535627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.535973 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.536323 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.537054 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.539250 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.549178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1355/2738] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:31.553214 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.556504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3225ab-804f-424c-a047-408b0d436b50 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.561255 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.562138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.562276 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55241b-3f79-4dd8-aeec-4f8834c02f1e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.562421 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.562696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] PATH_INFO: `/v3/users/3670561ad4ea4b2a9c40935c7231eeea` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.563914 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3670561ad4ea4b2a9c40935c7231eeea)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.565859 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.566768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf67a0-3c96-4b86-8d29-abb6f7e946b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.567601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf67a0-3c96-4b86-8d29-abb6f7e946b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.567882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf67a0-3c96-4b86-8d29-abb6f7e946b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.568158 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf67a0-3c96-4b86-8d29-abb6f7e946b2 admin admin] PATH_INFO: `/v3/projects/7ff0dc47d22a4f40b4ce8dc07a9e7837/users/9d0440bd23f94e9b8c79f909d8cd501b/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.570166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf67a0-3c96-4b86-8d29-abb6f7e946b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff0dc47d22a4f40b4ce8dc07a9e7837, user_id=9d0440bd23f94e9b8c79f909d8cd501b, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.572720 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf67a0-3c96-4b86-8d29-abb6f7e946b2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.582631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1356/2739] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:31 2022] PUT /identity/v3/projects/7ff0dc47d22a4f40b4ce8dc07a9e7837/users/9d0440bd23f94e9b8c79f909d8cd501b/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:31.592834 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.593120 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.593432 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.622027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] MFA Rules not processed for user `9d0440bd23f94e9b8c79f909d8cd501b`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:31.623235 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:31.704365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1357/2740] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:31.715318 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.717034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:31.770858 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3670561ad4ea4b2a9c40935c7231eeea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:31.772150 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3670561ad4ea4b2a9c40935c7231eeea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:31.777496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef841f3-7b5f-49da-81ae-be279962f0d9 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:31.781191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e2082-54aa-4376-8e3a-8521bed25b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:31.781866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2082-54aa-4376-8e3a-8521bed25b2b service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.782147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2082-54aa-4376-8e3a-8521bed25b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.782426 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e2082-54aa-4376-8e3a-8521bed25b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.785883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3670561ad4ea4b2a9c40935c7231eeea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:31.793129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e2082-54aa-4376-8e3a-8521bed25b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:31.794696 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e2082-54aa-4376-8e3a-8521bed25b2b service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:31.804942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1358/2741] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:31.888279 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3670561ad4ea4b2a9c40935c7231eeea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:31.888902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3670561ad4ea4b2a9c40935c7231eeea'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:31.902499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1384/2742] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:31 2022] DELETE /identity/v3/users/3670561ad4ea4b2a9c40935c7231eeea => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:31.907053 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:31.907387 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:31.907659 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:31.925245 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:31.926496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:31.983352 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1359/2743] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:31.993777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:31.995322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:32.053876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbf2fa-beea-46bb-8eea-5260580b05f9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:32.057620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442574e-784a-4478-80e3-7a31b89e8f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:32.058258 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442574e-784a-4478-80e3-7a31b89e8f0d service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:32.058546 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442574e-784a-4478-80e3-7a31b89e8f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:32.058825 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442574e-784a-4478-80e3-7a31b89e8f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:32.067900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442574e-784a-4478-80e3-7a31b89e8f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:32.069882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442574e-784a-4478-80e3-7a31b89e8f0d service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:32.079424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1385/2744] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:32.627081 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:32.628933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:32.648764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e909af-5323-4e8f-b5a0-e3a9f47110e5 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:32.654176 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:32.655026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:32.655303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:32.655573 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] PATH_INFO: `/v3/projects/64cfc0bb637348d8ac2537b4710e9727` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:32.656937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64cfc0bb637348d8ac2537b4710e9727)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:32.659035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:32.813442 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cfc0bb637348d8ac2537b4710e9727', 'request_id': 'req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:32.928788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cfc0bb637348d8ac2537b4710e9727', 'request_id': 'req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:32.935270 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cfc0bb637348d8ac2537b4710e9727', 'request_id': 'req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:32.945090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] The token cache is being invalidate because project 64cfc0bb637348d8ac2537b4710e9727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:32.945411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:32.946030 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:32.947530 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1360/2745] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:32 2022] DELETE /identity/v3/projects/64cfc0bb637348d8ac2537b4710e9727 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:32.952396 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c841fb9-daf3-47f7-94ec-95bb9f9708c5 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:32.952848 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c841fb9-daf3-47f7-94ec-95bb9f9708c5 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:32.953059 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c841fb9-daf3-47f7-94ec-95bb9f9708c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:32.986139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-2c841fb9-daf3-47f7-94ec-95bb9f9708c5 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:32.987344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-2c841fb9-daf3-47f7-94ec-95bb9f9708c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:33.035417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.036849 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:33.047902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1386/2746] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:33.055591 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db786ee8-41a9-4847-ae7a-203ed9cd83ce None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.055880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db786ee8-41a9-4847-ae7a-203ed9cd83ce None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.056158 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db786ee8-41a9-4847-ae7a-203ed9cd83ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.076203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-db786ee8-41a9-4847-ae7a-203ed9cd83ce None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:33.076203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-db786ee8-41a9-4847-ae7a-203ed9cd83ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:33.082903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1387/2747] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:33.087471 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db786ee8-41a9-4847-ae7a-203ed9cd83ce None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.096216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db786ee8-41a9-4847-ae7a-203ed9cd83ce None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.102186 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc255f8-9acb-4a1f-acbe-6dbcac218a85 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.102856 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.103513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.103792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.104067 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.104792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:33.105642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.106697 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.107676 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d0440bd23f94e9b8c79f909d8cd501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0dc47d22a4f40b4ce8dc07a9e7837', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.108310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.108600 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.108881 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.109648 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:33.110213 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.112601 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.118861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1388/2748] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:26:33.123076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.127296 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1361/2749] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:26:33.128249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.132741 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9419eb-6c66-41fb-b8cc-5bf7e2405aa2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.137415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.137963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81528e2-d4a6-408f-a2b5-5f31b965e198 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.138107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.138313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.138582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.139268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.141119 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.142892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d0440bd23f94e9b8c79f909d8cd501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0dc47d22a4f40b4ce8dc07a9e7837', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.143517 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.145065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.145065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.145065 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.147231 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.261046 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1389/2750] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:33 2022] POST /identity/v3/projects => generated 399 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:33.264946 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.303170 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1362/2751] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:33 2022] POST /identity/v3/projects => generated 354 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:33.307481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.330083 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11bcdd-9621-446a-9816-0670a905cdad admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.391580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.391951 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.392235 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.392507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.393209 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.393868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea651-ff14-4152-ab6c-6b37646db1e0 tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.395324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.400018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d0440bd23f94e9b8c79f909d8cd501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0dc47d22a4f40b4ce8dc07a9e7837', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.401411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.402145 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.402603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.403504 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:33.403817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.405436 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.417143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1363/2752] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:26:33.451587 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.462331 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4210c-1703-4fb5-a822-85ba89c4d4ae tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.466894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d0440bd23f94e9b8c79f909d8cd501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0dc47d22a4f40b4ce8dc07a9e7837', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.467716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.467995 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.468497 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] PATH_INFO: `/v3/projects/6b5baaab3b5c4ef7a1ecfb85ef7e5bd2` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.469531 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6b5baaab3b5c4ef7a1ecfb85ef7e5bd2)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.471407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.497033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1390/2753] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:33 2022] POST /identity/v3/users => generated 300 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:33.498142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.508013 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cb55c-a6af-423f-a02b-fdf0396db6c9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.512811 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.513479 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.513768 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.514042 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.514767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.516336 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.530447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1391/2754] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:33.534044 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.543880 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b7e0-2723-42e0-a32e-f041634ac38d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.548522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.549151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.549473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.549750 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.550475 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.552033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.561567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1392/2755] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:33.565420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.575065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5359-76f2-4a86-87c7-1b63d86d731b admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:33.580627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5baaab3b5c4ef7a1ecfb85ef7e5bd2', 'request_id': 'req-31534186-d111-445b-9dde-5b08f7f45d0d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:33.628501 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:33.629327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.629610 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.629883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] PATH_INFO: `/v3/projects/b6e8bbe121834d35b4255c450a1c2500/users/5b150e8fb91f4b7e822ec56ad34096b8/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.643934 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e8bbe121834d35b4255c450a1c2500, user_id=5b150e8fb91f4b7e822ec56ad34096b8, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:33.647179 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:33.677144 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5baaab3b5c4ef7a1ecfb85ef7e5bd2', 'request_id': 'req-31534186-d111-445b-9dde-5b08f7f45d0d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:33.684290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5baaab3b5c4ef7a1ecfb85ef7e5bd2', 'request_id': 'req-31534186-d111-445b-9dde-5b08f7f45d0d'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:33.694698 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] The token cache is being invalidate because project 6b5baaab3b5c4ef7a1ecfb85ef7e5bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:33.694984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:33.695622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-31534186-d111-445b-9dde-5b08f7f45d0d tempest-VolumeQuotaClassesTest-1744854125 tempest-VolumeQuotaClassesTest-1744854125-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:33.697166 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1364/2756] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:33 2022] DELETE /identity/v3/projects/6b5baaab3b5c4ef7a1ecfb85ef7e5bd2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:33.746143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1393/2757] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:33 2022] PUT /identity/v3/projects/b6e8bbe121834d35b4255c450a1c2500/users/5b150e8fb91f4b7e822ec56ad34096b8/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:33.756781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.757067 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.757382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.782219 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] MFA Rules not processed for user `5b150e8fb91f4b7e822ec56ad34096b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:33.783411 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:33.846173 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1365/2758] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:33.972797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:33.974641 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:34.031024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e99271-4d55-412b-8895-f2198419afd7 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:34.034635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9f8fa-4f7f-464e-a328-a692a94ddb8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:34.035275 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9f8fa-4f7f-464e-a328-a692a94ddb8b service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:34.035554 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9f8fa-4f7f-464e-a328-a692a94ddb8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:34.035833 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9f8fa-4f7f-464e-a328-a692a94ddb8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:34.043947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9f8fa-4f7f-464e-a328-a692a94ddb8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:34.045410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9f8fa-4f7f-464e-a328-a692a94ddb8b service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:34.054723 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1394/2759] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:34.464829 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:34.467233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:34.536763 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fc29c-c689-4562-bac8-75ea108abc36 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:34.544787 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:34.545904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:34.546258 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:34.546613 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] PATH_INFO: `/v3/users/4c726089ea8a41d992bf6d990231a3e7` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:34.548303 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c726089ea8a41d992bf6d990231a3e7)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:34.551107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:34.776229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c726089ea8a41d992bf6d990231a3e7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:34.776868 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c726089ea8a41d992bf6d990231a3e7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:34.842512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c726089ea8a41d992bf6d990231a3e7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:34.855583 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c726089ea8a41d992bf6d990231a3e7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:34.856240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c726089ea8a41d992bf6d990231a3e7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:34.869034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1366/2760] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:34 2022] DELETE /identity/v3/users/4c726089ea8a41d992bf6d990231a3e7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:34.873353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:34.873713 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:34.874060 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:34.892368 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:34.893744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:34.954830 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1395/2761] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:34.966528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:34.967905 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:35.025730 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b6d7-dbeb-41d2-ba16-878d25c049c7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:35.029469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:35.030105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:35.030384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:35.030658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:35.039783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:35.041199 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:35.050560 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1367/2762] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:35.563979 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:35.565428 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:35.579359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcaf73-46d0-43cc-b5c0-f456a3897381 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:35.584681 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:35.585742 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:35.586030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:35.586306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] PATH_INFO: `/v3/projects/439f79920dfb4e7eaf8c69503de126e9` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:35.588084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439f79920dfb4e7eaf8c69503de126e9)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:35.590447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:35.705770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439f79920dfb4e7eaf8c69503de126e9', 'request_id': 'req-7829bce4-d5ad-4006-ad46-f8987556d867'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:35.797383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439f79920dfb4e7eaf8c69503de126e9', 'request_id': 'req-7829bce4-d5ad-4006-ad46-f8987556d867'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:35.803800 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439f79920dfb4e7eaf8c69503de126e9', 'request_id': 'req-7829bce4-d5ad-4006-ad46-f8987556d867'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:35.815577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] The token cache is being invalidate because project 439f79920dfb4e7eaf8c69503de126e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:35.815871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:35.816552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:35.818124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1396/2763] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:35 2022] DELETE /identity/v3/projects/439f79920dfb4e7eaf8c69503de126e9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:35.822094 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:35.831620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa026342-3df5-4d32-bc66-5beb287fda3d service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:35.886721 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:35.887657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:35.887933 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:35.888207 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] PATH_INFO: `/v3/users/9d0440bd23f94e9b8c79f909d8cd501b` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:35.889489 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0440bd23f94e9b8c79f909d8cd501b)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:35.891394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:36.106855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0440bd23f94e9b8c79f909d8cd501b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.107515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0440bd23f94e9b8c79f909d8cd501b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.190914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0440bd23f94e9b8c79f909d8cd501b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.203417 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0440bd23f94e9b8c79f909d8cd501b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.204140 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-bef3f719-7605-40f2-ae83-2d7af3d58072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0440bd23f94e9b8c79f909d8cd501b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.216265 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1368/2764] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:35 2022] DELETE /identity/v3/users/9d0440bd23f94e9b8c79f909d8cd501b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:36.654985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:36.656398 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:36.670531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829bce4-d5ad-4006-ad46-f8987556d867 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:36.728671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:36.729794 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:36.729916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:36.730107 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] PATH_INFO: `/v3/projects/7ff0dc47d22a4f40b4ce8dc07a9e7837` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:36.731385 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff0dc47d22a4f40b4ce8dc07a9e7837)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:36.733360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:36.871506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff0dc47d22a4f40b4ce8dc07a9e7837', 'request_id': 'req-e53f1965-3933-47fc-86cc-2f11e2cd5590'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.974151 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff0dc47d22a4f40b4ce8dc07a9e7837', 'request_id': 'req-e53f1965-3933-47fc-86cc-2f11e2cd5590'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.980041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff0dc47d22a4f40b4ce8dc07a9e7837', 'request_id': 'req-e53f1965-3933-47fc-86cc-2f11e2cd5590'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.991970 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] The token cache is being invalidate because project 7ff0dc47d22a4f40b4ce8dc07a9e7837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:36.996133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.996133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-e53f1965-3933-47fc-86cc-2f11e2cd5590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:36.996133 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1397/2765] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:36 2022] DELETE /identity/v3/projects/7ff0dc47d22a4f40b4ce8dc07a9e7837 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:36.999491 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbfb89-5edc-4070-99f1-710547451fd7 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:36.999963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbfb89-5edc-4070-99f1-710547451fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.000204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbfb89-5edc-4070-99f1-710547451fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.020203 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-adfbfb89-5edc-4070-99f1-710547451fd7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:37.021433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-adfbfb89-5edc-4070-99f1-710547451fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:37.078175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1369/2766] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:37.085906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22307c-f120-4d91-bb19-a832f9ba3afd None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.086198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22307c-f120-4d91-bb19-a832f9ba3afd None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.086476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22307c-f120-4d91-bb19-a832f9ba3afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.104611 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-7c22307c-f120-4d91-bb19-a832f9ba3afd None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:37.105849 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7c22307c-f120-4d91-bb19-a832f9ba3afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:37.113908 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1398/2767] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:37.118334 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbfb89-5edc-4070-99f1-710547451fd7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:37.127722 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbfb89-5edc-4070-99f1-710547451fd7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:37.132300 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:37.132959 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.133236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.133547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.134295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:37.134622 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:37.136193 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:37.147122 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1370/2768] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:26:37.151286 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22307c-f120-4d91-bb19-a832f9ba3afd None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:37.160322 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22307c-f120-4d91-bb19-a832f9ba3afd None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:37.165516 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:37.166147 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.166430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.166707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.167409 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:37.169377 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:37.290474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1399/2769] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:37 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:37.294661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:37.306008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3ba3-6ac9-44d8-a52f-a380d727f4c7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:37.358159 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:37.358805 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.359083 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.359356 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.360298 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:37.362225 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:37.483407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1371/2770] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:37 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:37.487765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:37.498138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca2fac-12f3-42e3-926a-7e84e93c1e27 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:37.502677 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:37.503354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.503639 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.503945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.504714 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:37.506344 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:37.516671 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1400/2771] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:37.520522 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:37.532378 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2a07-5bad-4f41-b6b1-15d2e4141c2e admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:37.537090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c569c7-3d2d-47e3-a3ac-0bf0c9c37bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:37.537710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c569c7-3d2d-47e3-a3ac-0bf0c9c37bce admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.537992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c569c7-3d2d-47e3-a3ac-0bf0c9c37bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.538948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c569c7-3d2d-47e3-a3ac-0bf0c9c37bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.539678 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c569c7-3d2d-47e3-a3ac-0bf0c9c37bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:37.541253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c569c7-3d2d-47e3-a3ac-0bf0c9c37bce admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:37.550992 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1372/2772] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:37.555329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:37.565029 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890cb7c-f058-4bb1-b694-23825e38852c admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:37.569647 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:37.570504 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.570783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.571055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] PATH_INFO: `/v3/projects/54de907a473a4990ac7b233b8db5c442/users/566b7e13b41a423982bd9b0f73655200/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.585808 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54de907a473a4990ac7b233b8db5c442, user_id=566b7e13b41a423982bd9b0f73655200, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:37.588430 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:37.699879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1401/2773] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:37 2022] PUT /identity/v3/projects/54de907a473a4990ac7b233b8db5c442/users/566b7e13b41a423982bd9b0f73655200/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:37.711867 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3814-5d26-4e34-a342-c5500787898b None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.712157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3814-5d26-4e34-a342-c5500787898b None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.712437 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3814-5d26-4e34-a342-c5500787898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.741840 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-92fb3814-5d26-4e34-a342-c5500787898b None None] MFA Rules not processed for user `566b7e13b41a423982bd9b0f73655200`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:37.743035 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-92fb3814-5d26-4e34-a342-c5500787898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:37.806581 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1373/2774] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:37.811239 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:37.871200 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ece4a-6426-478a-93c7-6213d603bd39 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:37.875855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:37.878114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:37.878114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:37.878114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:37.878114 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:37.879567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:37.997425 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1402/2775] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:37 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:38.001541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3814-5d26-4e34-a342-c5500787898b None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:38.012616 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3814-5d26-4e34-a342-c5500787898b None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:38.068201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:38.068861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.069143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.069976 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.070690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:38.072596 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:38.202790 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1374/2776] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:38 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:38.206509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:38.217077 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f27c5-c867-407f-a626-1481d460f431 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:38.221578 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:38.222234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.222569 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.222847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.223577 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:38.225236 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:38.235642 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1403/2777] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:38.239402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:38.249482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f47d6-1017-4fd1-bc08-045c5321250f admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:38.254010 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:38.254855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.255132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.255405 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] PATH_INFO: `/v3/projects/30ae9e883b814d3aaf093c7bcfa7f8b7/users/2b0b96b792cf42bd8718fdca7664734e/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.270784 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ae9e883b814d3aaf093c7bcfa7f8b7, user_id=2b0b96b792cf42bd8718fdca7664734e, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:38.273408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:38.413878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1375/2778] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:38 2022] PUT /identity/v3/projects/30ae9e883b814d3aaf093c7bcfa7f8b7/users/2b0b96b792cf42bd8718fdca7664734e/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:38.417765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:38.427585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702c171-0f87-411f-91eb-b66f84fa412a admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:38.481088 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124962b7-9f5f-4706-9b68-c508eed54e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:38.481771 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124962b7-9f5f-4706-9b68-c508eed54e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.482049 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124962b7-9f5f-4706-9b68-c508eed54e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.482324 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124962b7-9f5f-4706-9b68-c508eed54e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.483070 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124962b7-9f5f-4706-9b68-c508eed54e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:38.484707 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124962b7-9f5f-4706-9b68-c508eed54e81 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:38.494844 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1404/2779] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:38.498918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:38.509402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aebd15-04f0-49e9-9f21-2a6f585f1dca admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:38.513904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:38.514759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.515039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.515365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] PATH_INFO: `/v3/projects/30ae9e883b814d3aaf093c7bcfa7f8b7/users/2b0b96b792cf42bd8718fdca7664734e/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.517382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ae9e883b814d3aaf093c7bcfa7f8b7, user_id=2b0b96b792cf42bd8718fdca7664734e, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:38.519962 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:38.529918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1376/2780] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:38 2022] PUT /identity/v3/projects/30ae9e883b814d3aaf093c7bcfa7f8b7/users/2b0b96b792cf42bd8718fdca7664734e/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:38.539727 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.540015 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.540290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.566442 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] MFA Rules not processed for user `2b0b96b792cf42bd8718fdca7664734e`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:38.567648 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:38.632826 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1405/2781] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:38.642098 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:38.662999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:38.700036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08665-88b6-4987-955a-c5989420c21a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:38.703904 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a9e24-8116-4e18-8678-da53161b37c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:38.704532 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9e24-8116-4e18-8678-da53161b37c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.704815 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9e24-8116-4e18-8678-da53161b37c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.705092 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a9e24-8116-4e18-8678-da53161b37c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.758944 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a9e24-8116-4e18-8678-da53161b37c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:38.760373 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a9e24-8116-4e18-8678-da53161b37c2 service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:38.768984 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1377/2782] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:43.252248 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:43.253678 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:43.315982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f04a9-7819-456c-819a-59be9f603b2e None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:43.321214 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:43.322096 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.322381 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.322687 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] PATH_INFO: `/v3/users/5b150e8fb91f4b7e822ec56ad34096b8` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.323974 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b150e8fb91f4b7e822ec56ad34096b8)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:43.325916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:43.524779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b150e8fb91f4b7e822ec56ad34096b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:43.525389 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b150e8fb91f4b7e822ec56ad34096b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:43.536969 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b150e8fb91f4b7e822ec56ad34096b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:43.619583 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b150e8fb91f4b7e822ec56ad34096b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:43.620195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b150e8fb91f4b7e822ec56ad34096b8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:43.632524 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1406/2783] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:43 2022] DELETE /identity/v3/users/5b150e8fb91f4b7e822ec56ad34096b8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:43.637542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.638051 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.638148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.654864 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:43.656032 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:43.711128 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1378/2784] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:43.720855 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:43.722290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:43.780451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b7a3-482e-4646-ad62-c0e9188423b2 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:43.784226 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:43.784891 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.785174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.785484 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.794458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:43.795871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:43.805703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1407/2785] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:44.000319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:44.018577 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:44.064168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a852d-ded8-4c58-a79c-ef661088bafb None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:44.064168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfd166-d912-4214-806f-3707bfb3330a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:44.064168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd166-d912-4214-806f-3707bfb3330a service cinder] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:44.064168 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd166-d912-4214-806f-3707bfb3330a service cinder] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:44.064597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd166-d912-4214-806f-3707bfb3330a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:44.064597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-89dfd166-d912-4214-806f-3707bfb3330a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:44.123216 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfd166-d912-4214-806f-3707bfb3330a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:44.124668 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfd166-d912-4214-806f-3707bfb3330a service cinder] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:44.137462 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1379/2786] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:44.375969 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:44.377544 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:44.391243 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26677d8a-faf8-421c-9aec-64874437469c service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:44.396063 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:44.396911 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:44.397199 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:44.397507 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] PATH_INFO: `/v3/projects/b6e8bbe121834d35b4255c450a1c2500` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:44.398738 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e8bbe121834d35b4255c450a1c2500)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:44.400753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:44.528078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e8bbe121834d35b4255c450a1c2500', 'request_id': 'req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:44.613522 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e8bbe121834d35b4255c450a1c2500', 'request_id': 'req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:44.619185 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e8bbe121834d35b4255c450a1c2500', 'request_id': 'req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:44.629893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] The token cache is being invalidate because project b6e8bbe121834d35b4255c450a1c2500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:44.630183 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:44.630802 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-295ba56e-4ab2-43f0-b23c-497d97d8a9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:44.632315 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1408/2787] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:44 2022] DELETE /identity/v3/projects/b6e8bbe121834d35b4255c450a1c2500 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:44.637798 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65305f-154a-4ca3-b5a6-63cb512923f7 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:44.640418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65305f-154a-4ca3-b5a6-63cb512923f7 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:44.640418 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65305f-154a-4ca3-b5a6-63cb512923f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:44.657319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-de65305f-154a-4ca3-b5a6-63cb512923f7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:44.658540 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-de65305f-154a-4ca3-b5a6-63cb512923f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:44.714771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1380/2788] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:44.722764 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c73dc-2cbc-4c47-8978-f325cfa8a0f7 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:44.723181 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c73dc-2cbc-4c47-8978-f325cfa8a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:44.723581 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c73dc-2cbc-4c47-8978-f325cfa8a0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:44.743592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a69c73dc-2cbc-4c47-8978-f325cfa8a0f7 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:44.745312 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a69c73dc-2cbc-4c47-8978-f325cfa8a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:44.753364 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1409/2789] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:44.758208 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65305f-154a-4ca3-b5a6-63cb512923f7 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:44.767661 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65305f-154a-4ca3-b5a6-63cb512923f7 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:44.772268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:44.772898 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:44.773179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:44.774050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:44.774781 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:44.775090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:44.776820 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:44.788293 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1381/2790] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:44.792606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c73dc-2cbc-4c47-8978-f325cfa8a0f7 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:44.801837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c73dc-2cbc-4c47-8978-f325cfa8a0f7 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:44.806453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:44.807111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:44.807388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:44.807659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:44.808510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:44.810464 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:44.934807 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1410/2791] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:44 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:44.936033 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:44.946996 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdb610-f76b-4814-95e8-833c11460804 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:45.005744 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:45.006446 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:45.006725 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:45.006997 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:45.008365 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:45.010327 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:45.127236 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1382/2792] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:44 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:26:45.128308 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:45.139223 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0ce0e-0d58-4fef-a1ad-10a31d15e772 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:45.144142 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:45.145115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:45.145489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:45.145792 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:45.146568 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:45.148161 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:45.159740 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1411/2793] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:45.163656 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:45.173844 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6280de-134d-4b4d-8ba1-ccd4c2bcaff1 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:45.179175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5741f-356e-4902-a4b0-a18428cf0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:45.180388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5741f-356e-4902-a4b0-a18428cf0b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:45.180667 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5741f-356e-4902-a4b0-a18428cf0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:45.180940 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5741f-356e-4902-a4b0-a18428cf0b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:45.181728 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5741f-356e-4902-a4b0-a18428cf0b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:45.183496 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5741f-356e-4902-a4b0-a18428cf0b69 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:45.193967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1383/2794] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:45.198732 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:45.208405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a7245-f12e-42c9-9cc8-83c5c955e099 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:45.213057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:45.213941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:45.214221 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:45.214494 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] PATH_INFO: `/v3/projects/1092010e5d02415b9ba03f62ba4ffe10/users/cfe451f65ec449499a947853f550e08a/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:45.228781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1092010e5d02415b9ba03f62ba4ffe10, user_id=cfe451f65ec449499a947853f550e08a, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:45.231441 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:45.340564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1412/2795] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:45 2022] PUT /identity/v3/projects/1092010e5d02415b9ba03f62ba4ffe10/users/cfe451f65ec449499a947853f550e08a/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:45.345831 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:45.346222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:45.346571 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:45.364454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:45.365799 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:45.427631 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1384/2796] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:45.437550 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:45.439282 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:45.495786 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d3ff4-b2f0-4512-9018-eaeb80fdd9c8 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:45.499478 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495afca-bf08-4b7d-8e12-b45b447e9afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:45.500110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495afca-bf08-4b7d-8e12-b45b447e9afe service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:45.500391 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495afca-bf08-4b7d-8e12-b45b447e9afe service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:45.500659 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495afca-bf08-4b7d-8e12-b45b447e9afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:45.510301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495afca-bf08-4b7d-8e12-b45b447e9afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:45.511728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495afca-bf08-4b7d-8e12-b45b447e9afe service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:45.521210 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1413/2797] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:50.097059 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:50.104461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:50.113311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfecd6-b6d1-4507-9c7d-705f011aa229 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:50.118855 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:50.119733 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:50.120018 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:50.120292 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] PATH_INFO: `/v3/users/566b7e13b41a423982bd9b0f73655200` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:50.121713 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=566b7e13b41a423982bd9b0f73655200)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:50.123469 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:50.335639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566b7e13b41a423982bd9b0f73655200'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:50.336808 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566b7e13b41a423982bd9b0f73655200'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:50.408055 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566b7e13b41a423982bd9b0f73655200'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:50.425768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566b7e13b41a423982bd9b0f73655200'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:50.426502 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566b7e13b41a423982bd9b0f73655200'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:50.440608 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1385/2798] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:50 2022] DELETE /identity/v3/users/566b7e13b41a423982bd9b0f73655200 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:50.445143 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:50.445676 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:50.445772 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:50.469323 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:50.470909 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:50.538383 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1414/2799] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:50.547874 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:50.549586 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:50.613994 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a579261-effa-4cb7-8517-c50e49316a85 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:50.617665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc2c9-2790-4fc9-a745-eeb371ee196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:50.618401 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc2c9-2790-4fc9-a745-eeb371ee196e service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:50.618688 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc2c9-2790-4fc9-a745-eeb371ee196e service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:50.618987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc2c9-2790-4fc9-a745-eeb371ee196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:50.628031 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cc2c9-2790-4fc9-a745-eeb371ee196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:50.629501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297cc2c9-2790-4fc9-a745-eeb371ee196e service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:50.639585 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1386/2800] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:51.099927 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.105797 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.126660 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885f596-5bdc-468a-bbb4-051b18b41d35 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.132679 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.133923 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.135075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.135650 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] PATH_INFO: `/v3/projects/54de907a473a4990ac7b233b8db5c442` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.137084 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54de907a473a4990ac7b233b8db5c442)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.146146 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:51.195830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.196372 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.196471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.227485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] MFA Rules not processed for user `cfe451f65ec449499a947853f550e08a`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:51.228712 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.301747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54de907a473a4990ac7b233b8db5c442', 'request_id': 'req-c6aaa530-3c5e-4269-b722-2a54c1fb7467'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.314903 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1387/2801] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:51.319339 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.321226 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.334914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da80f32-0dbf-4202-b622-2172c177381d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.392416 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.393075 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.393511 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.393789 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.394548 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.396459 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:51.401883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54de907a473a4990ac7b233b8db5c442', 'request_id': 'req-c6aaa530-3c5e-4269-b722-2a54c1fb7467'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.409521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54de907a473a4990ac7b233b8db5c442', 'request_id': 'req-c6aaa530-3c5e-4269-b722-2a54c1fb7467'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.425620 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] The token cache is being invalidate because project 54de907a473a4990ac7b233b8db5c442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:51.425915 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.426586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.430051 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1415/2802] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:51 2022] DELETE /identity/v3/projects/54de907a473a4990ac7b233b8db5c442 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:51.433653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.435174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.450027 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa530-3c5e-4269-b722-2a54c1fb7467 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.455883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.455883 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.456332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.456332 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] PATH_INFO: `/v3/users/2b0b96b792cf42bd8718fdca7664734e` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.457576 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0b96b792cf42bd8718fdca7664734e)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.459489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:51.540906 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1388/2803] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:51 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:51.544757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.546507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.632046 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f367-cf32-462a-b37c-6c82ac585dd2 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.639169 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.639850 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.640130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.640404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.641124 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.643084 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:51.702613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0b96b792cf42bd8718fdca7664734e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.703289 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0b96b792cf42bd8718fdca7664734e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.718867 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0b96b792cf42bd8718fdca7664734e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.723741 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1389/2804] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:51 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:51.727348 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.738937 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27916c30-2f50-4ad2-b397-d6b572a00559 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.744244 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.746148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.746148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.746148 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.746427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.747895 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:51.759090 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1390/2805] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:51.763427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.773601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0b96b792cf42bd8718fdca7664734e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.774229 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0b96b792cf42bd8718fdca7664734e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:51.774528 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ff078-9d11-4874-9e2c-a341e1bac04a admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.780642 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.781817 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.782249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.782702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] PATH_INFO: `/v3/projects/92cbbf632e2046c2bfba10d625520a95/users/5c3c439cb3df4456ac45afd1c6f6743a/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.789371 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1416/2806] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:51 2022] DELETE /identity/v3/users/2b0b96b792cf42bd8718fdca7664734e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:51.803687 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cbbf632e2046c2bfba10d625520a95, user_id=5c3c439cb3df4456ac45afd1c6f6743a, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.806034 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:51.861101 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1391/2807] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:51 2022] PUT /identity/v3/projects/92cbbf632e2046c2bfba10d625520a95/users/5c3c439cb3df4456ac45afd1c6f6743a/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:51.865360 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.867967 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.934716 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335221b7-0760-41cd-ba8d-01a779364ff9 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.994454 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.995137 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.995422 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.995706 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.999245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.999245 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:52.010618 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1417/2808] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:52.014861 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:52.026702 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64f3f3-6f00-4dc3-a3da-4229a19cb34b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:52.032188 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2fb83-d0ae-4085-866a-5b0cb05605bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:52.033424 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fb83-d0ae-4085-866a-5b0cb05605bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.033773 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fb83-d0ae-4085-866a-5b0cb05605bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.034222 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2fb83-d0ae-4085-866a-5b0cb05605bf admin admin] PATH_INFO: `/v3/projects/92cbbf632e2046c2bfba10d625520a95/users/5c3c439cb3df4456ac45afd1c6f6743a/roles/8302aa99fb20433b8a0329ec7c83740c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.036654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2fb83-d0ae-4085-866a-5b0cb05605bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cbbf632e2046c2bfba10d625520a95, user_id=5c3c439cb3df4456ac45afd1c6f6743a, role_id=8302aa99fb20433b8a0329ec7c83740c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:52.040085 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2fb83-d0ae-4085-866a-5b0cb05605bf admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:52.052624 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1392/2809] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:52 2022] PUT /identity/v3/projects/92cbbf632e2046c2bfba10d625520a95/users/5c3c439cb3df4456ac45afd1c6f6743a/roles/8302aa99fb20433b8a0329ec7c83740c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:52.217263 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:52.219918 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:52.236140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbaa016-435a-467a-97cf-7e872ba82272 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:52.303564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:52.304447 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.304734 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.309729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] PATH_INFO: `/v3/projects/30ae9e883b814d3aaf093c7bcfa7f8b7` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.309729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ae9e883b814d3aaf093c7bcfa7f8b7)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:52.309729 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:52.426370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ae9e883b814d3aaf093c7bcfa7f8b7', 'request_id': 'req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:52.613572 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ae9e883b814d3aaf093c7bcfa7f8b7', 'request_id': 'req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:52.620038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ae9e883b814d3aaf093c7bcfa7f8b7', 'request_id': 'req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:52.631940 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] The token cache is being invalidate because project 30ae9e883b814d3aaf093c7bcfa7f8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:52.632288 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:52.633162 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-aeeb3824-8c9f-41a0-8c12-d7d5e243307f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:52.635249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1418/2810] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:52 2022] DELETE /identity/v3/projects/30ae9e883b814d3aaf093c7bcfa7f8b7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:52.641011 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425ff5-8a6e-4dee-8a37-58d6111f4a31 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.641927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425ff5-8a6e-4dee-8a37-58d6111f4a31 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.642266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425ff5-8a6e-4dee-8a37-58d6111f4a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.662430 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-89425ff5-8a6e-4dee-8a37-58d6111f4a31 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:52.663719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-89425ff5-8a6e-4dee-8a37-58d6111f4a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:52.733927 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1393/2811] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:52.743420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe36b-88bb-48e8-88cd-7000fc05ac2f None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.743718 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe36b-88bb-48e8-88cd-7000fc05ac2f None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.743988 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe36b-88bb-48e8-88cd-7000fc05ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.765703 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-abdfe36b-88bb-48e8-88cd-7000fc05ac2f None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:52.766989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-abdfe36b-88bb-48e8-88cd-7000fc05ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:52.775313 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1419/2812] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:52.779618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89425ff5-8a6e-4dee-8a37-58d6111f4a31 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:52.789234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89425ff5-8a6e-4dee-8a37-58d6111f4a31 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:52.793882 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:52.794516 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.794793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.795063 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.795785 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:52.796087 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:52.797701 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:52.809841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1394/2813] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:52.815016 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe36b-88bb-48e8-88cd-7000fc05ac2f None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:52.825733 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe36b-88bb-48e8-88cd-7000fc05ac2f None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:52.830589 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:52.831281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.831571 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.831850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.832560 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:52.834735 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:52.924357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1420/2814] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:52 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:52.925778 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:52.937509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303d163-917d-4145-9e46-d42d4f015826 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:53.006431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:53.008384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:53.008384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:53.008384 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:53.008878 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:53.011171 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:53.153452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1395/2815] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:52 2022] POST /identity/v3/users => generated 281 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:53.157157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:53.169702 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54cf6d-219b-455f-b16e-183a3e744a01 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:53.175531 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:53.176203 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:53.176492 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:53.176775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:53.177575 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:53.179476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:53.195991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1421/2816] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:53.199156 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:53.213654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27692-be12-43ec-81b7-c002abd111c6 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:53.220157 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db220d-2ae1-4ccd-a439-5fc990fbb72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:53.221695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db220d-2ae1-4ccd-a439-5fc990fbb72f admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:53.222164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db220d-2ae1-4ccd-a439-5fc990fbb72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:53.222614 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db220d-2ae1-4ccd-a439-5fc990fbb72f admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:53.223527 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db220d-2ae1-4ccd-a439-5fc990fbb72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:53.225604 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db220d-2ae1-4ccd-a439-5fc990fbb72f admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:53.241132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1396/2817] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:53.245893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:53.256134 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484a414-55b6-4a2f-8936-840d1cfbad9d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:53.260760 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:53.261657 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:53.261937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:53.262207 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] PATH_INFO: `/v3/projects/2812ba7e6426448c87e1275251526ce4/users/4027025fed4b4fdd9547d192fac45c9b/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:53.279470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2812ba7e6426448c87e1275251526ce4, user_id=4027025fed4b4fdd9547d192fac45c9b, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:53.282451 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:53.363353 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1422/2818] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:53 2022] PUT /identity/v3/projects/2812ba7e6426448c87e1275251526ce4/users/4027025fed4b4fdd9547d192fac45c9b/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:53.377615 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f3c92-4204-4eb4-b3d1-44fcd3f6fdef None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:53.378388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f3c92-4204-4eb4-b3d1-44fcd3f6fdef None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:53.378388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f3c92-4204-4eb4-b3d1-44fcd3f6fdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:53.412914 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-b20f3c92-4204-4eb4-b3d1-44fcd3f6fdef None None] MFA Rules not processed for user `4027025fed4b4fdd9547d192fac45c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:53.414942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b20f3c92-4204-4eb4-b3d1-44fcd3f6fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:53.493249 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1397/2819] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:53.530149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:53.530149 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:53.591358 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586080-97b4-4e6b-92a7-7ee3c9e9c400 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:53.595580 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cc6bc-6593-4586-bc7d-dd15e53c4afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:53.596521 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc6bc-6593-4586-bc7d-dd15e53c4afd service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:53.597069 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc6bc-6593-4586-bc7d-dd15e53c4afd service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:53.597775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc6bc-6593-4586-bc7d-dd15e53c4afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:53.607512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cc6bc-6593-4586-bc7d-dd15e53c4afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:53.609087 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cc6bc-6593-4586-bc7d-dd15e53c4afd service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:53.622547 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1423/2820] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:53.637102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f3c92-4204-4eb4-b3d1-44fcd3f6fdef None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:53.707266 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f3c92-4204-4eb4-b3d1-44fcd3f6fdef None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:53.712514 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:53.713566 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:53.713892 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:53.714162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] PATH_INFO: `/v3/users/4027025fed4b4fdd9547d192fac45c9b` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:53.715377 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4027025fed4b4fdd9547d192fac45c9b)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:53.717309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:53.950729 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4027025fed4b4fdd9547d192fac45c9b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:53.951505 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4027025fed4b4fdd9547d192fac45c9b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:54.020105 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4027025fed4b4fdd9547d192fac45c9b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:54.052201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4027025fed4b4fdd9547d192fac45c9b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:54.054153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4027025fed4b4fdd9547d192fac45c9b'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:54.076160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1398/2821] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:26:53 2022] DELETE /identity/v3/users/4027025fed4b4fdd9547d192fac45c9b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:54.080847 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:54.081139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:54.081696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:54.100047 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:54.101473 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:54.178601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1424/2822] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:54.180179 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:54.181754 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:54.312673 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa6f16-b044-467c-b28e-6035f85e39d0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:54.318201 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5b9ad-9c3f-418a-8e3c-39d8e9c0b237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:54.321114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5b9ad-9c3f-418a-8e3c-39d8e9c0b237 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:54.321114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5b9ad-9c3f-418a-8e3c-39d8e9c0b237 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:54.321114 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5b9ad-9c3f-418a-8e3c-39d8e9c0b237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:54.331782 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5b9ad-9c3f-418a-8e3c-39d8e9c0b237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:54.334684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5b9ad-9c3f-418a-8e3c-39d8e9c0b237 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:54.352361 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1399/2823] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:54.917788 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:54.919281 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:54.930835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd07e49-2e58-4126-89a3-15a480386f5b None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:54.937390 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:54.945065 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:54.945765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:54.946058 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] PATH_INFO: `/v3/projects/2812ba7e6426448c87e1275251526ce4` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:54.947606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2812ba7e6426448c87e1275251526ce4)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:54.949903 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:55.078992 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2812ba7e6426448c87e1275251526ce4', 'request_id': 'req-7e357ef6-2137-4377-9388-febe53517af8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:55.145663 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2812ba7e6426448c87e1275251526ce4', 'request_id': 'req-7e357ef6-2137-4377-9388-febe53517af8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:55.158439 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2812ba7e6426448c87e1275251526ce4', 'request_id': 'req-7e357ef6-2137-4377-9388-febe53517af8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:55.174747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] The token cache is being invalidate because project 2812ba7e6426448c87e1275251526ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:26:55.175041 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:55.175899 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-7e357ef6-2137-4377-9388-febe53517af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:26:55.177783 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1425/2824] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:26:54 2022] DELETE /identity/v3/projects/2812ba7e6426448c87e1275251526ce4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:26:55.183987 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5791-e743-460b-b90b-f92abe0d1641 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.184438 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5791-e743-460b-b90b-f92abe0d1641 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.184618 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d5791-e743-460b-b90b-f92abe0d1641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.212089 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-685d5791-e743-460b-b90b-f92abe0d1641 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:55.213975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-685d5791-e743-460b-b90b-f92abe0d1641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:55.311768 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1400/2825] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:55.328206 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f066-f811-400d-b26d-be0c87c7d707 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.329066 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f066-f811-400d-b26d-be0c87c7d707 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.329588 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135f066-f811-400d-b26d-be0c87c7d707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.369317 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-5135f066-f811-400d-b26d-be0c87c7d707 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:55.370688 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-5135f066-f811-400d-b26d-be0c87c7d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:55.379726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1426/2826] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:55.385654 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5791-e743-460b-b90b-f92abe0d1641 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:55.400330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d5791-e743-460b-b90b-f92abe0d1641 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:55.419886 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:55.420684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.420877 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.421131 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.422359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:26:55.422359 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:55.424139 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:55.464234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1401/2827] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:26:55.468720 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135f066-f811-400d-b26d-be0c87c7d707 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:55.481023 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135f066-f811-400d-b26d-be0c87c7d707 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:55.490784 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:55.493810 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.494103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.494387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.495120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:55.497061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:55.605154 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1427/2828] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:26:55 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:55.609355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:55.632319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f3c13-361b-4b90-bf52-50d68d1a39e7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:55.703920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:55.704764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.705050 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.705407 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.706119 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:55.708104 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:55.798404 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1402/2829] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:26:55 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:26:55.802564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:55.814220 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aaa94-5c82-42eb-9962-67d5fbea0800 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:55.819165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:55.819851 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.820770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.821055 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.821840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:55.823509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:55.837991 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1428/2830] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:26:55.839278 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:55.849663 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affbae9-57b5-4040-9e4b-8f8c7a62058b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:55.855460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3ebd-225e-43ca-bb46-bd8a3ca35ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:55.856130 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3ebd-225e-43ca-bb46-bd8a3ca35ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.856788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3ebd-225e-43ca-bb46-bd8a3ca35ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.856788 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3ebd-225e-43ca-bb46-bd8a3ca35ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.857580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a3ebd-225e-43ca-bb46-bd8a3ca35ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:55.859364 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a3ebd-225e-43ca-bb46-bd8a3ca35ffc admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:55.875223 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1403/2831] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:26:55.876401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:55.886466 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d3b42-2923-4b7b-8387-45c711a46ede admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:55.893174 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:55.894126 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:55.894410 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:55.894689 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] PATH_INFO: `/v3/projects/7316cdfb717d436ba175f042ef6af8e9/users/21e58bef43b549be8570519513ab81a4/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:55.909894 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7316cdfb717d436ba175f042ef6af8e9, user_id=21e58bef43b549be8570519513ab81a4, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:55.912539 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:56.018411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1429/2832] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:26:55 2022] PUT /identity/v3/projects/7316cdfb717d436ba175f042ef6af8e9/users/21e58bef43b549be8570519513ab81a4/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:26:56.020291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0580-6948-42af-8d05-183f65f0ce52 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:56.020542 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0580-6948-42af-8d05-183f65f0ce52 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:56.021044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0580-6948-42af-8d05-183f65f0ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:56.052240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-f92f0580-6948-42af-8d05-183f65f0ce52 None None] MFA Rules not processed for user `21e58bef43b549be8570519513ab81a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:56.053487 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f92f0580-6948-42af-8d05-183f65f0ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:56.153003 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1404/2833] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:56.163615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:56.166090 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:56.268341 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adc701-0dcc-4e0a-82e3-d7fde79bd880 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:56.272803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f343848a5b4660bfcfe68795a7fcee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:56.273884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:56.274631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:56.274631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:56.292837 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:56.294453 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:56.311170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1430/2834] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:58.065322 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:58.065841 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:58.066143 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:58.099599 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] MFA Rules not processed for user `5c3c439cb3df4456ac45afd1c6f6743a`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:58.101001 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:58.190320 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1405/2835] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:58.201906 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:58.204172 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:58.296592 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b999c-1643-4fc4-863d-aa043ea751a6 service glance] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:58.302945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e1409-2300-44d3-ab24-da9babd337c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:58.303598 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e1409-2300-44d3-ab24-da9babd337c1 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:58.303882 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e1409-2300-44d3-ab24-da9babd337c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:58.304159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e1409-2300-44d3-ab24-da9babd337c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:58.306627 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-919e1409-2300-44d3-ab24-da9babd337c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:58.380075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e1409-2300-44d3-ab24-da9babd337c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:58.381563 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e1409-2300-44d3-ab24-da9babd337c1 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:58.392033 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1431/2836] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:09.120212 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:09.121637 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:09.189677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da26c5-52dc-4808-b0be-3b15edddbb0d None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:09.194981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:09.195623 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:09.195958 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:09.196242 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:09.198039 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:09.210233 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:09.211797 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:09.222178 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1406/2837] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:24.130393 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b28ee9-3bba-44b0-a95f-a25450a627f1 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:24.130983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b28ee9-3bba-44b0-a95f-a25450a627f1 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:24.130983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b28ee9-3bba-44b0-a95f-a25450a627f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:24.148130 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-67b28ee9-3bba-44b0-a95f-a25450a627f1 None None] MFA Rules not processed for user `cfe451f65ec449499a947853f550e08a`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:24.151152 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-67b28ee9-3bba-44b0-a95f-a25450a627f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:24.156744 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1432/2838] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:27:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:36.849715 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:36.910921 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b3444-7839-47e9-8380-db0dd8f72cfa service placement] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:36.915525 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:36.916367 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:36.916645 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:36.916918 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] PATH_INFO: `/v3/users/21e58bef43b549be8570519513ab81a4` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:36.918129 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e58bef43b549be8570519513ab81a4)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:36.920016 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:37.156492 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e58bef43b549be8570519513ab81a4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:37.157160 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e58bef43b549be8570519513ab81a4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:37.223501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e58bef43b549be8570519513ab81a4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:37.235340 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e58bef43b549be8570519513ab81a4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:37.235894 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e58bef43b549be8570519513ab81a4'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:37.247934 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1407/2839] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:27:36 2022] DELETE /identity/v3/users/21e58bef43b549be8570519513ab81a4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:27:37.253103 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:37.253597 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:37.253709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:37.270602 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:37.271781 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:37.327512 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1433/2840] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:37.337164 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:37.338602 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:37.393325 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764f9e1-23b3-4334-b803-d369bc0c268b admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:37.396827 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dda84e-7cba-4c21-9028-034ca6def41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:37.397481 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dda84e-7cba-4c21-9028-034ca6def41e service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:37.397759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dda84e-7cba-4c21-9028-034ca6def41e service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:37.398026 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dda84e-7cba-4c21-9028-034ca6def41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:37.408137 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dda84e-7cba-4c21-9028-034ca6def41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:37.409620 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dda84e-7cba-4c21-9028-034ca6def41e service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:37.418956 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1408/2841] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:38.150985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.152400 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:38.164498 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133d515-754a-45a0-b96b-3fdb93683b00 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.169140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.170030 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.170314 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.170595 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] PATH_INFO: `/v3/projects/7316cdfb717d436ba175f042ef6af8e9` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.171799 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7316cdfb717d436ba175f042ef6af8e9)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.173779 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:38.274963 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7316cdfb717d436ba175f042ef6af8e9', 'request_id': 'req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:38.343893 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7316cdfb717d436ba175f042ef6af8e9', 'request_id': 'req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:38.349943 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7316cdfb717d436ba175f042ef6af8e9', 'request_id': 'req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:38.360785 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] The token cache is being invalidate because project 7316cdfb717d436ba175f042ef6af8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:27:38.361355 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:38.361984 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-96b5f8fc-0a8b-491b-9ae0-16e77bac77b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:27:38.363506 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1434/2842] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:27:38 2022] DELETE /identity/v3/projects/7316cdfb717d436ba175f042ef6af8e9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:27:38.368349 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027624-0205-4152-968d-6d7d4e25c59e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.368819 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027624-0205-4152-968d-6d7d4e25c59e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.368935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027624-0205-4152-968d-6d7d4e25c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.387135 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-aa027624-0205-4152-968d-6d7d4e25c59e None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:38.388328 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-aa027624-0205-4152-968d-6d7d4e25c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:38.453175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1409/2843] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:38.454820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055af4c-4563-4761-b4af-91b5b5243d8c None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.455108 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055af4c-4563-4761-b4af-91b5b5243d8c None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.455388 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055af4c-4563-4761-b4af-91b5b5243d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.473165 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-7055af4c-4563-4761-b4af-91b5b5243d8c None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:38.474387 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7055af4c-4563-4761-b4af-91b5b5243d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:38.482129 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1435/2844] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:38.487006 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa027624-0205-4152-968d-6d7d4e25c59e None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.496240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa027624-0205-4152-968d-6d7d4e25c59e None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.501547 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.502180 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.502460 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.502731 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] PATH_INFO: `/v3/domains` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.503451 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:27:38.503750 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.505345 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:38.516454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1410/2845] 10.222.0.31 () {58 vars in 1152 bytes} [Sat Feb 12 04:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:27:38.520401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055af4c-4563-4761-b4af-91b5b5243d8c None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.529306 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055af4c-4563-4761-b4af-91b5b5243d8c None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.533965 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.534601 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.534885 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.535160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.535861 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.537875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:38.625954 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1436/2846] 10.222.0.31 () {60 vars in 1152 bytes} [Sat Feb 12 04:27:38 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:27:38.629794 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.639552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb7c38-45d7-476d-9d49-3293e4466826 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.693079 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.693762 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.694042 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.694317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.695029 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.696957 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:38.818290 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1411/2847] 10.222.0.31 () {60 vars in 1143 bytes} [Sat Feb 12 04:27:38 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:27:38.822319 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.832459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe8ac-daef-4d2f-a39f-aa59f6f41b68 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.837173 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.837840 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.838120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.838402 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.839115 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.840767 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:38.851420 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1437/2848] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:27:38.858924 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.865736 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560d9cf-fd43-4201-8000-3123851c6ef0 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.870516 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20fe7-16f0-444c-8f1b-01cc8453f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.871150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20fe7-16f0-444c-8f1b-01cc8453f5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.871431 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20fe7-16f0-444c-8f1b-01cc8453f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.871707 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20fe7-16f0-444c-8f1b-01cc8453f5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.872433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20fe7-16f0-444c-8f1b-01cc8453f5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.874132 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc20fe7-16f0-444c-8f1b-01cc8453f5d5 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:38.883719 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1412/2849] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 04:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:27:38.887582 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.897195 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72a6c-5358-4197-9ef7-926902480de4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.901691 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.902542 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.902820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.903093 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] PATH_INFO: `/v3/projects/5863100afb0b4ebb855a9acf332162b6/users/6c0709b6a5ee494f889ce149ccc9579c/roles/64a2c6a95efd482bb4146a547361d31c` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.917182 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5863100afb0b4ebb855a9acf332162b6, user_id=6c0709b6a5ee494f889ce149ccc9579c, role_id=64a2c6a95efd482bb4146a547361d31c)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.919817 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:39.001213 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1438/2850] 10.222.0.31 () {60 vars in 1482 bytes} [Sat Feb 12 04:27:38 2022] PUT /identity/v3/projects/5863100afb0b4ebb855a9acf332162b6/users/6c0709b6a5ee494f889ce149ccc9579c/roles/64a2c6a95efd482bb4146a547361d31c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:27:39.011371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764af3-e607-4e2d-a858-af6e03136b8e None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:39.011658 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764af3-e607-4e2d-a858-af6e03136b8e None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:39.011935 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764af3-e607-4e2d-a858-af6e03136b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:39.038127 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-98764af3-e607-4e2d-a858-af6e03136b8e None None] MFA Rules not processed for user `6c0709b6a5ee494f889ce149ccc9579c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:39.039388 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-98764af3-e607-4e2d-a858-af6e03136b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:39.107183 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1413/2851] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:27:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:39.117510 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:39.119157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:39.174820 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a52b9-9b73-4cfa-95ca-64a9970089dc admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:39.178775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ee2e293bd2649f0b6d5aa13dc02ea89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:39.179411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:39.179709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:39.179978 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:39.188529 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:39.189994 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:39.199022 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1439/2852] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:40.964025 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8221e-6160-4b72-b88a-2a7bd6aa8561 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:40.964493 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8221e-6160-4b72-b88a-2a7bd6aa8561 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:40.964580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8221e-6160-4b72-b88a-2a7bd6aa8561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:40.981975 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-9ce8221e-6160-4b72-b88a-2a7bd6aa8561 None None] MFA Rules not processed for user `6c0709b6a5ee494f889ce149ccc9579c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:40.983774 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-9ce8221e-6160-4b72-b88a-2a7bd6aa8561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:40.994100 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1414/2853] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:27:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:45.485073 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:45.486902 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:45.543038 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedb680-2ca3-4c32-adce-464ec689c167 service cinder] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:45.546695 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:45.547327 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:45.547607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:45.547876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:45.549658 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:45.612357 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:45.613765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:45.624503 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1440/2854] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:57.268989 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337cb0e-eeec-47a3-aee9-a3394b8a40ee None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:57.271304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337cb0e-eeec-47a3-aee9-a3394b8a40ee None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:57.271304 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337cb0e-eeec-47a3-aee9-a3394b8a40ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:57.288044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-e337cb0e-eeec-47a3-aee9-a3394b8a40ee None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:57.289259 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e337cb0e-eeec-47a3-aee9-a3394b8a40ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:57.340268 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1415/2855] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:27:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:57.484378 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:57.485854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:57.554930 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56766-0390-4e2c-b271-aba9f13caec3 service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:57.559947 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:57.560586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:57.560868 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:57.561144 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:57.569770 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:57.571335 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:57.579696 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1441/2856] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:27:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:27:58.355644 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c88ad-b11a-4e88-b68e-772b302df603 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:58.356107 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c88ad-b11a-4e88-b68e-772b302df603 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:58.356218 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c88ad-b11a-4e88-b68e-772b302df603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:58.374443 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-1b3c88ad-b11a-4e88-b68e-772b302df603 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:58.375657 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1b3c88ad-b11a-4e88-b68e-772b302df603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:58.382757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1416/2857] 10.222.0.31 () {58 vars in 967 bytes} [Sat Feb 12 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:58.394821 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:58.405570 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fdc35-8f80-4ccf-9ffc-d6ded3ef1850 service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:58.410459 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:58.411078 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:58.411359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:58.411635 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:58.419567 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:58.421765 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:58.429728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1442/2858] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:27:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:27:59.154261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d56690-ad50-4e7d-b106-1182f02ba205 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:59.154552 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d56690-ad50-4e7d-b106-1182f02ba205 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:59.158627 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d56690-ad50-4e7d-b106-1182f02ba205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:59.172036 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-73d56690-ad50-4e7d-b106-1182f02ba205 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:59.173229 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-73d56690-ad50-4e7d-b106-1182f02ba205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:59.180444 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1417/2859] 10.222.0.31 () {58 vars in 1009 bytes} [Sat Feb 12 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:59.192564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:59.203832 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87fb7b-7683-4025-bffb-2166be3ae021 service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:59.208949 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:59.209607 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:59.209884 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:59.210159 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:59.218057 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:59.219649 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:59.227458 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1443/2860] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:27:59.770174 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f1ca-b9fc-4317-a517-150acdcb2045 None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:59.770651 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f1ca-b9fc-4317-a517-150acdcb2045 None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:59.770759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2f1ca-b9fc-4317-a517-150acdcb2045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:59.789175 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-ada2f1ca-b9fc-4317-a517-150acdcb2045 None None] MFA Rules not processed for user `9729abb9423b49cea97da93095e90c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:59.790399 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-ada2f1ca-b9fc-4317-a517-150acdcb2045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:59.798509 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1418/2861] 10.222.0.31 () {58 vars in 967 bytes} [Sat Feb 12 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:59.810489 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:59.820725 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9adc64-a81e-48f9-9aea-46d206776ded service swift] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:59.825656 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832f279-32c6-4014-b75e-f28662e8260b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f8eac55c400472296dfec3a113799d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:59.826268 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f279-32c6-4014-b75e-f28662e8260b service swift] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:59.826545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f279-32c6-4014-b75e-f28662e8260b service swift] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:59.826814 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832f279-32c6-4014-b75e-f28662e8260b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:59.834460 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832f279-32c6-4014-b75e-f28662e8260b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:59.836002 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832f279-32c6-4014-b75e-f28662e8260b service swift] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:59.844218 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1444/2862] 10.222.0.31 () {60 vars in 1384 bytes} [Sat Feb 12 04:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:28:02.321311 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2f1ca-b9fc-4317-a517-150acdcb2045 None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:02.381810 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2f1ca-b9fc-4317-a517-150acdcb2045 None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:02.386382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:02.387234 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:02.387510 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:02.387783 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] PATH_INFO: `/v3/users/6c0709b6a5ee494f889ce149ccc9579c` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:02.388963 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0709b6a5ee494f889ce149ccc9579c)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:02.390920 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:02.562205 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0709b6a5ee494f889ce149ccc9579c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:02.564485 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0709b6a5ee494f889ce149ccc9579c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:02.629013 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0709b6a5ee494f889ce149ccc9579c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:02.640408 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0709b6a5ee494f889ce149ccc9579c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:02.641037 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0709b6a5ee494f889ce149ccc9579c'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:02.652716 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1419/2863] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:28:02 2022] DELETE /identity/v3/users/6c0709b6a5ee494f889ce149ccc9579c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:28:02.657435 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:02.657937 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:02.658072 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:02.675805 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] MFA Rules not processed for user `11bc38186327459cb57d952300827ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:02.676975 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:02.732097 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1445/2864] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:02.742452 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:02.743860 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:02.798147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d009888-77e6-4be5-a7c5-75481e9df804 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:02.801760 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:02.802394 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:02.802674 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:02.802948 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:02.811643 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:02.813109 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:02.822080 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1420/2865] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:28:03.031424 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:03.032829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:03.045857 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4452d-affc-425a-a539-147774f5c191 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:03.051234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:03.052585 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:03.052871 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:03.053346 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] PATH_INFO: `/v3/projects/5863100afb0b4ebb855a9acf332162b6` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:03.054613 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5863100afb0b4ebb855a9acf332162b6)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:03.056509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:03.160574 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5863100afb0b4ebb855a9acf332162b6', 'request_id': 'req-175ac99f-078c-4ed1-9505-f80c38ac0c20'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:03.229545 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5863100afb0b4ebb855a9acf332162b6', 'request_id': 'req-175ac99f-078c-4ed1-9505-f80c38ac0c20'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:03.235024 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5863100afb0b4ebb855a9acf332162b6', 'request_id': 'req-175ac99f-078c-4ed1-9505-f80c38ac0c20'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:03.245854 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] The token cache is being invalidate because project 5863100afb0b4ebb855a9acf332162b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:28:03.246139 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:03.246753 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:03.248244 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1446/2866] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:28:03 2022] DELETE /identity/v3/projects/5863100afb0b4ebb855a9acf332162b6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:28:22.309828 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:22.318295 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b61904-cc43-418a-8ede-a4ede9c13546 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:22.364724 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:22.365382 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:22.365665 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:22.365938 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:22.367710 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:22.426541 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:22.427969 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:22.437291 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1421/2867] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:29.464160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:29.465728 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:29.479140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ac99f-078c-4ed1-9505-f80c38ac0c20 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:29.483638 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:29.484509 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:29.484787 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:29.485062 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] PATH_INFO: `/v3/users/489271f8dc5a432792bea8521abf5eb8` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:29.486301 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=489271f8dc5a432792bea8521abf5eb8)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:29.488457 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:29.591481 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489271f8dc5a432792bea8521abf5eb8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:29.592135 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489271f8dc5a432792bea8521abf5eb8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:29.604274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489271f8dc5a432792bea8521abf5eb8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:29.640350 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489271f8dc5a432792bea8521abf5eb8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:29.640985 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489271f8dc5a432792bea8521abf5eb8'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:29.653136 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1447/2868] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:28:29 2022] DELETE /identity/v3/users/489271f8dc5a432792bea8521abf5eb8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:28:29.911572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:29.921565 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd7954-87be-4703-80ce-5eec6c684466 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:29.981910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:29.982759 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:29.983040 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:29.983319 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] PATH_INFO: `/v3/projects/9562939d04a04f868c738263f2375b8e` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:29.984523 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9562939d04a04f868c738263f2375b8e)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:29.986454 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:30.096942 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9562939d04a04f868c738263f2375b8e', 'request_id': 'req-164b96ee-6baf-426c-aff0-f22af2369505'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.154999 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9562939d04a04f868c738263f2375b8e', 'request_id': 'req-164b96ee-6baf-426c-aff0-f22af2369505'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.161360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9562939d04a04f868c738263f2375b8e', 'request_id': 'req-164b96ee-6baf-426c-aff0-f22af2369505'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.171397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] The token cache is being invalidate because project 9562939d04a04f868c738263f2375b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:28:30.171684 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.172306 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.174488 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1422/2869] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:28:29 2022] DELETE /identity/v3/projects/9562939d04a04f868c738263f2375b8e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:28:30.178487 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:30.179879 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:30.193160 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b6831-cdb1-4ac3-88d3-e0207950f0cd admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:30.246704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:30.247555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:30.247835 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:30.248104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] PATH_INFO: `/v3/users/4a5cac73601b499c9963d1adfbf2cd4e` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:30.249304 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5cac73601b499c9963d1adfbf2cd4e)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:30.251234 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:30.401651 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5cac73601b499c9963d1adfbf2cd4e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.402297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5cac73601b499c9963d1adfbf2cd4e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.413704 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5cac73601b499c9963d1adfbf2cd4e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.486747 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5cac73601b499c9963d1adfbf2cd4e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.487624 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5cac73601b499c9963d1adfbf2cd4e'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.499709 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1448/2870] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:28:30 2022] DELETE /identity/v3/users/4a5cac73601b499c9963d1adfbf2cd4e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:28:30.746102 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:30.747564 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:30.760429 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b96ee-6baf-426c-aff0-f22af2369505 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:30.814830 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:30.815670 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:30.815981 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:30.816254 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] PATH_INFO: `/v3/projects/d2d151eaae9c4abfbfde825711ad3fe2` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:30.817477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d151eaae9c4abfbfde825711ad3fe2)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:30.819371 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:30.903524 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d151eaae9c4abfbfde825711ad3fe2', 'request_id': 'req-7cc80f52-1773-41bf-88f1-aee14e05ea92'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.954771 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d151eaae9c4abfbfde825711ad3fe2', 'request_id': 'req-7cc80f52-1773-41bf-88f1-aee14e05ea92'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.961695 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d151eaae9c4abfbfde825711ad3fe2', 'request_id': 'req-7cc80f52-1773-41bf-88f1-aee14e05ea92'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.972332 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] The token cache is being invalidate because project d2d151eaae9c4abfbfde825711ad3fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:28:30.972621 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.973246 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:28:30.974791 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1423/2871] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:28:30 2022] DELETE /identity/v3/projects/d2d151eaae9c4abfbfde825711ad3fe2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:29:44.720875 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:29:44.722470 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:44.777401 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149674b0-cd9f-4aa6-bcc0-c5db2012ed1d admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:29:44.822586 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:29:44.823216 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:29:44.823499 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:29:44.823777 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:29:44.825552 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:44.891737 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:29:44.893170 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:29:44.903790 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1449/2872] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:29:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:29:46.077873 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:29:46.079818 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:46.091919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc80f52-1773-41bf-88f1-aee14e05ea92 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:29:46.096071 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f619e9-d1fe-45cc-8919-8b0f9f66c5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:29:46.096690 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f619e9-d1fe-45cc-8919-8b0f9f66c5ca service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:29:46.096967 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f619e9-d1fe-45cc-8919-8b0f9f66c5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:29:46.097240 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f619e9-d1fe-45cc-8919-8b0f9f66c5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:29:46.099027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-e4f619e9-d1fe-45cc-8919-8b0f9f66c5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:46.111901 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f619e9-d1fe-45cc-8919-8b0f9f66c5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:29:46.113597 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f619e9-d1fe-45cc-8919-8b0f9f66c5ca service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:29:46.124117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1424/2873] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:29:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:29:47.260249 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:29:47.261356 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:47.275061 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cce47-c508-419c-b2e0-95aa22eb320f service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:29:47.282011 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:29:47.282655 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:29:47.283111 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:29:47.283561 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:29:47.285876 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:47.299617 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:29:47.301211 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:29:47.312989 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1450/2874] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:29:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:29:49.526253 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98333936-3618-4708-8ccc-111df1125abf None None] REQUEST_METHOD: `POST` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:29:49.526757 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98333936-3618-4708-8ccc-111df1125abf None None] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:29:49.526866 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98333936-3618-4708-8ccc-111df1125abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:29:49.544501 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.auth.core [None req-98333936-3618-4708-8ccc-111df1125abf None None] MFA Rules not processed for user `cfe451f65ec449499a947853f550e08a`. Rule list: `[]` (Enabled: `True`). {{(pid=79509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:29:49.546355 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-98333936-3618-4708-8ccc-111df1125abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:49.607471 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1425/2875] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:29:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:29:49.909555 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:29:49.918631 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2a316-4b4c-4c09-9e35-0e7126642571 service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:29:49.922230 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:29:49.922850 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:29:49.923131 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:29:49.923405 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:29:49.925140 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:49.934593 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:29:49.936196 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:29:49.943945 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1451/2876] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:29:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:29:50.943027 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98333936-3618-4708-8ccc-111df1125abf None None] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:29:50.944482 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-98333936-3618-4708-8ccc-111df1125abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:51.012603 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98333936-3618-4708-8ccc-111df1125abf None None] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:29:51.018434 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:29:51.019070 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:29:51.019351 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:29:51.019625 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:29:51.021397 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:51.033309 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:29:51.034859 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:29:51.044507 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1426/2877] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:29:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:29:53.852176 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:29:53.861775 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18339e58-ec9e-4420-97aa-73f7835cbc0d service neutron] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:29:53.868110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6b202-3a99-4766-8931-d4ce9d3fba00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:29:53.868110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6b202-3a99-4766-8931-d4ce9d3fba00 service neutron] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:29:53.868110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6b202-3a99-4766-8931-d4ce9d3fba00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:29:53.868110 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6b202-3a99-4766-8931-d4ce9d3fba00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:29:53.869351 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-7ab6b202-3a99-4766-8931-d4ce9d3fba00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:29:53.879936 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6b202-3a99-4766-8931-d4ce9d3fba00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:29:53.881411 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6b202-3a99-4766-8931-d4ce9d3fba00 service neutron] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:29:53.894261 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1452/2878] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:29:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:30:05.674503 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:05.676116 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:05.691576 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c9847-2ae2-4353-a3b2-48008a56c853 service placement] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:05.696965 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:05.697633 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:05.697919 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:05.698191 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:05.699910 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:05.711512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:05.714267 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:05.723317 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1427/2879] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:30:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:31:51.596290 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2467-bd5a-4b3f-90f9-1a2a324e7961 None None] REQUEST_METHOD: `POST` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:51.596803 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2467-bd5a-4b3f-90f9-1a2a324e7961 None None] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:51.596932 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2467-bd5a-4b3f-90f9-1a2a324e7961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:51.623476 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.auth.core [None req-fd7c2467-bd5a-4b3f-90f9-1a2a324e7961 None None] MFA Rules not processed for user `cfe451f65ec449499a947853f550e08a`. Rule list: `[]` (Enabled: `True`). {{(pid=79510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:51.624667 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-fd7c2467-bd5a-4b3f-90f9-1a2a324e7961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:51.647474 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1453/2880] 10.222.0.31 () {58 vars in 957 bytes} [Sat Feb 12 04:31:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:31:51.951718 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:51.990147 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f28191-5f3f-4e73-b35a-65aaf6c44d40 service nova] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:51.993746 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:51.994370 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:51.994652 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:51.994923 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:51.997162 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:52.018095 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:52.019445 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:52.027153 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1428/2881] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:31:58.743900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c2467-bd5a-4b3f-90f9-1a2a324e7961 None None] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:58.780564 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c2467-bd5a-4b3f-90f9-1a2a324e7961 None None] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:58.785983 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:58.786606 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:58.786886 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:58.787157 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:58.788863 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:58.799287 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:58.800829 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:58.810104 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1454/2882] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:32:12.478555 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:32:12.499402 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca9e7-0948-45b0-aed8-a06f29a62b13 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:32:12.504310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:32:12.504931 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:12.505211 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:12.505512 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:12.507261 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:32:12.531310 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:32:12.532908 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:32:12.542580 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1429/2883] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:32:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:39.432297 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:39.445091 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13d80-9f82-420b-8aac-5e1655c8bd75 service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:39.450982 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4509a13ccb074c5e9d8440755da77cc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:39.451629 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:39.451916 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:39.452198 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:39.454726 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:39.482959 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:39.485637 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:39.498342 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1455/2884] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:54.132433 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:54.141572 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54787d1-c8f0-4b87-977e-6dddcfef1f6b service placement] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:54.145639 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5157463790394bcbae9c0d7e5812f37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:54.146255 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] REQUEST_METHOD: `GET` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:54.146534 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:54.146807 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:54.148515 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:54.228117 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:54.229579 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:54.247764 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1430/2885] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:01.571634 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:01.574415 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:01.587526 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f708-15c5-47bd-b53a-9547e9ed618d service nova] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:01.592135 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:01.593266 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:01.593584 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:01.593866 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] PATH_INFO: `/v3/users/cfe451f65ec449499a947853f550e08a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:01.595076 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe451f65ec449499a947853f550e08a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:01.597615 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:01.784485 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe451f65ec449499a947853f550e08a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.785124 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe451f65ec449499a947853f550e08a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.796382 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe451f65ec449499a947853f550e08a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.874036 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe451f65ec449499a947853f550e08a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.874649 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe451f65ec449499a947853f550e08a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.888040 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1456/2886] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:01 2022] DELETE /identity/v3/users/cfe451f65ec449499a947853f550e08a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:02.145008 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:02.155342 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a59af7-d3fd-4e0d-8d69-386ed131c791 service neutron] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:02.210556 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:02.211399 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:02.211677 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:02.211951 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] PATH_INFO: `/v3/projects/1092010e5d02415b9ba03f62ba4ffe10` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:02.213146 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1092010e5d02415b9ba03f62ba4ffe10)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:02.215150 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:02.319196 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1092010e5d02415b9ba03f62ba4ffe10', 'request_id': 'req-1652f2c3-a68e-484c-af3c-79ff085132c7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.394204 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1092010e5d02415b9ba03f62ba4ffe10', 'request_id': 'req-1652f2c3-a68e-484c-af3c-79ff085132c7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.400427 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1092010e5d02415b9ba03f62ba4ffe10', 'request_id': 'req-1652f2c3-a68e-484c-af3c-79ff085132c7'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.411044 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] The token cache is being invalidate because project 1092010e5d02415b9ba03f62ba4ffe10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:02.411330 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.411943 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.413461 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1431/2887] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:02 2022] DELETE /identity/v3/projects/1092010e5d02415b9ba03f62ba4ffe10 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:02.417877 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:02.419274 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:02.432469 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418cd56-63ee-48e3-a6e7-2d10d7b30de0 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:02.487907 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:02.488756 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:02.489035 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:02.489329 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] PATH_INFO: `/v3/users/5c3c439cb3df4456ac45afd1c6f6743a` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:02.490513 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3c439cb3df4456ac45afd1c6f6743a)` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:02.492666 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:02.750407 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3c439cb3df4456ac45afd1c6f6743a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.751138 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3c439cb3df4456ac45afd1c6f6743a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.762354 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3c439cb3df4456ac45afd1c6f6743a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.809333 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3c439cb3df4456ac45afd1c6f6743a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.809941 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.notifications [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3c439cb3df4456ac45afd1c6f6743a'} {{(pid=79510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.822075 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1457/2888] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:02 2022] DELETE /identity/v3/users/5c3c439cb3df4456ac45afd1c6f6743a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:03.067723 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Authenticating user token {{(pid=79509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.069121 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.fernet_utils [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.085406 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f2c3-a68e-484c-af3c-79ff085132c7 admin admin] Validating token access rules against request {{(pid=79509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.137870 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11bc38186327459cb57d952300827ad5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea391da9e944423da861a63f18f0eef9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.138704 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.138980 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.139248 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] PATH_INFO: `/v3/projects/92cbbf632e2046c2bfba10d625520a95` {{(pid=79509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.140425 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92cbbf632e2046c2bfba10d625520a95)` {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.142360 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] RBAC: Authorization granted {{(pid=79509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.239494 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cbbf632e2046c2bfba10d625520a95', 'request_id': 'req-f3794ee2-842c-42a7-9ea5-1130d4e47b33'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.309793 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cbbf632e2046c2bfba10d625520a95', 'request_id': 'req-f3794ee2-842c-42a7-9ea5-1130d4e47b33'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.410477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cbbf632e2046c2bfba10d625520a95', 'request_id': 'req-f3794ee2-842c-42a7-9ea5-1130d4e47b33'} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.410477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] The token cache is being invalidate because project 92cbbf632e2046c2bfba10d625520a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:03.410477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.410477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: DEBUG keystone.notifications [None req-f3794ee2-842c-42a7-9ea5-1130d4e47b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.410477 dv-cinder-828696-3-iscsi devstack@keystone.service[79509]: [pid: 79509|app: 0|req: 1432/2889] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:03 2022] DELETE /identity/v3/projects/92cbbf632e2046c2bfba10d625520a95 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:37:18.472359 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Authenticating user token {{(pid=79510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:37:18.473900 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:37:18.540878 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa750a-0c4b-440b-9ad5-b282766a0fb4 admin admin] Validating token access rules against request {{(pid=79510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:37:18.597436 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02288-91db-4c82-857b-82ef3a94f790 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8156242719464c85ae77a332fe5d5eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46fe5a5e9fcb4fc7a47807e754d95b70', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:37:18.598082 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02288-91db-4c82-857b-82ef3a94f790 service placement] REQUEST_METHOD: `GET` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:37:18.598370 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02288-91db-4c82-857b-82ef3a94f790 service placement] SCRIPT_NAME: `/identity` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:37:18.598653 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02288-91db-4c82-857b-82ef3a94f790 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:37:18.600444 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.fernet_utils [None req-8fa02288-91db-4c82-857b-82ef3a94f790 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:37:18.611517 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02288-91db-4c82-857b-82ef3a94f790 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:37:18.613120 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02288-91db-4c82-857b-82ef3a94f790 service placement] RBAC: Authorization granted {{(pid=79510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:37:18.623177 dv-cinder-828696-3-iscsi devstack@keystone.service[79510]: [pid: 79510|app: 0|req: 1458/2890] 10.222.0.31 () {60 vars in 1365 bytes} [Sat Feb 12 04:37:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)